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This nonograph is an account of the orqanizational structure, iranagenent , 
and operation of ths Work Incentive (WIN) rrograip frop the Federal to ths 
local level.. H\\e study v;as undertaken at tlie request of the Office of 
Work Incentive Procrrams— a program designed to help vrelfare recipients 
obtain erploynent. TON is administered iointlv bv the Deoartment of 
Iftibor and tho Departnent of Health, Education, and Welfare &t ea^h 
governmental level. The progran faces significant managerent questions 
which evolve from the need to uni.te two agencies in the provision of two 
types of services — social services and eirpldyrrent services. 

The study looks inside the "black box" of prbgram implementation and 
service delivery at those factors which characterize top performing 
VHN programs. It answers the traditional managoiient question: do 
some programs outf^erform others, even after their labor market and 
client environments are taken into account? i^fter systematically 
identifying and controlling for those environmental factors which affect 
program performance, the researchers ranked State and local ITIN programs 
on four standardized WIN perforrnnce measures. A sanple of high and low 
performers were selected for more indepth research on management issues, 
such as goal awareness, t^'pe and extent of staff training, reporting 
accuracy, monitoring frequency and 1^^, and styles of lateral and 
horizontal communication. Ihis comparison of high and low performers 
indicated that systematic differences existed which explained why some 
programs were high performers and others lc»; performers. The study 
concludes by recommending concrete steps which Federal, State, and 

local VJIN programs could undertake to irprove their performance. 

i 

In addition to clecirly addressing the needs of IJIN program operators 
at all levels of the system., the study should be of interest to a v;ide 
range of human resource program planners, managers, trainers, and 
evaluators. It contains invaluable lessons for the welfare reformer 
seeking to combine the delivery 6f botli social services and eirployment 
and training opportunities. Lastly, the organizational theorist will 
find that the monograph provides a unique case sbJidy of the strategies 
required for managing a system which must unite the services of two 
agencies. 
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EXECUTIVE SUWARY 

* * 



This reporr examines factors that influence the effectiveness of 
state and local units of the Work Incentive (WIN) program and suggests 
ways of Improving the performance of this welfare-employment program. 
The report^ focuses on the organizational, managerial and service delivery 
characteristics that our research indicated were conducive to high per- 
formance. It alsp discusses the environmental factors, such as demo- 
graphic and labor market conditions, which affect WIN performance at the 
state and local level. 

This report is based on data collected and analyzed over a two- 
year period. Extensive field research was conducted in A3 local, sites 
and ten states as well as regional and Washington offices in both the 
Department of Labor (DOL) and the Department of Health, Education, and 
Welfare (HEW). Our approach was to study what dtf f er'entiated high per- 
forming programs from low performers and to use that knowledge as the 
basis for recommendations. This summary presents our major findings and 
recommendations . 

♦ 

1. The WIN System 

•The WIN program was established by the Social Security Amend- 
ments of 1967. Its purposo is to move recipients of Aid, to Families 
with Dependent Children (AFUC) into productive' jobs, thereby increas- 
ing their self-sufficiency and reducing welfare rolls and expenditures. 
WIN is the Joint responsibility of DOL and HEW. 

I 

Since its inception, the program has undergone periodic legis- 
lative and policy changes that altered its emphasis from training and 
developmental services to immediate, unsubsidized employment; mandated 
participation for most categories of adults receiving AFDC; and shifted 
program responsibilities from welfare to employment and training agen- 
cies. By 1979 the direction of WIN had gradually changed again — from 
maximizing immediate job placement to a more "balanced" iapproach that 
was also concerned with the wage level and permanence of the jobs ob- 
tained. In addition to direct placement and training, the current pro- 
gram model includes employability planning, job search instruction, child 
care, transportation, various types of counseling, and other supportive 
serv Ices . 

In 1978 the program had about 1.6 million registrants nation- 
wide, approximately 35 percent of all AFDC heads of household. They 
wore served by about 13,000 staff located in all states, the District 
of Columbia, Puerto Rico, Guam and the Virgin Islands. Federal funding 
for FY 1979 was $388 million. 
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WIN Is unique in that it Is jointly administered by two different 
agencies at. each governmental level. A National Coordinating Committee 
tNCC) composed of the Assistant Secretary of Ubor for Employment and 

Training (DOL«ETA) and the Administrator of the Office of Human Development 
.Services (HEW-OHDS) has statutory responsibility. Program operation is 
delegated to a National Executive Director. The Office of Work Incentive 
Programs (OWIN) is housed in DDL but is an integrated unit consisting 
of personnel from both DOL and HEW. This structure Is replicated at the 
.federal regional office level. 

In all but two states zhe employment security agency (SESA) Is 
^o*.';!"^^^ ^''^ designated "WIN sponsor." A Separate Administrative Unit 
(SAU) has been established in every state welfare agency to handle WIN 
responsibilities. Unlike the federal units, the state programs are not 
Integrated. Most state WIN sponsor and SAU administrative personnel are 
located organizationally and physically in their respective agencies. 

Below the state level, the pattern of dual organizational re- 
sponsibility is continued in all but a few cases. Most local WIN service 
delivery systems Involve separate SAU and sponsor units, even though they 
are sometimes collocated. The linkages between these pairs of units and 
from each unit to its host welfare or employment security agency vary 
considerably. ^ o j / 

2. Environment and Program Performance 

The socio-economic environments within which WIN programs operate 
significantly Influence their performance levels. Four main measures of 
that performance were Identified which reflect the current balanced mission 
of WIN to find jobs for as many registrants as possible while also 
Increasing the wage level and duration of those jobs. The four measures 
we ire • 

• Number of job entries per staff. 

• Average job entry wage. 

• Retention rate. 

• Average monthly welfare grant reduction. 

These measures were standardized to permit state-to-state comparisons 
and were statistically adjusted to take Into account differences In labor 
market and client difficulty. Programs were Identified as high performers 
If they performed tetter than expected given their socio-economic environ^ 
ment on a composite Index of the four measures. Those that performed 
worse than expected were Identified as low performers. 
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Statistical analysis showed that socio-economic environment ex- 
plained a high proportion of the variance In state and local WIN perform- 
ance on these measures • Data on 214 local units In ten states revealed 
that labor market and demographic environment accounted for about one-third 
to one-half of the differences In performance among local WIN programs* 
Thus, for example, 52*1 percent of the variation In average WIN local job 
entry wage levels was attributable to the combined effect of five factors — 
presence of low wage Industries, average employer size, poverty population, 
male registrants, and local employment growth* 

These findings have Important Implications for resource allocation 
decisions on the national, regional and state level* They 'suggest the pos- 
sibility that allocation formulas might be developed that provide perform- 
ance Incentives while taking Into account the relative difficulty of labor 
market and demographic conditions facing different state or local WIN 
programs* 

Data on the economic and client demographic factors affecting per- 
formance can also be useful in evaluation or management analysis because 
they permit comparisons to be made despite differences In environment* 
The information may also assist planning .and locatlonal decisions, since 
it suggests ways to predict more precisely what potential performance can 
be expected from WIN operations in different kinds of communities* 

Unlike socio-economic environment, differences in political- 
bureaucratic environment were not shown to be associated with variations 
in performance. Federal regional offices' impact on state and local pro- 
gram performance was generally quite limited, although regional WIN units 
were quite diverse in how they allocated funds, participated in state 
plan development, conducted site reviews, and interacted with states* 

State level elected officials were generally unaware of and un- 
interested in WIN. With one exception their impact on program policy was 
extremely limited. Lobbying groups almost wholly ignored WIN in our ten 
study states. Legislative and executive review of WIN budgets were gener- 
ally cursory, although in several states they resulted either in authorized 
SAU positions being limited or Title XX funding being earmarked for WIN* 

Political interventions were reportedly extensive and frequent in 
half the programs in our sample. They took the form of special treatment 
for particular registrants or interference In personnel and procurement 
decisions. However, analysis revealed no relationship between state pro- 
gram performance and political intrusions. Similarly, the responsiveness 
and flexibility of support systems such as administrative service agencies 
and state personnel departments varied across the sample but were not as- 
sociated with differences in performance* 



3. State WIN Programs 

. High performing state WIN programs tended to be managed differently 

than low performers. Their leaders imparted to local WIN sponsor staff a 
clearer perception of national program goals, Including the balanced Impor- 
tance of both the quality and the quantity of job entries. SAU personnel 
defined their mission not only as providing social services to registrants 
but also as creating linkages to income maintenance units and Title XX. 
Goal displacement and resource diversion by host agencies was Infrequent 
or minimal . ^ 

High performance In state WIN pr igrams was also associated with; 

• More frequent and extensive training of staff, often 
conducted jointly for sponsor and SAU personnel. 

• Relatively accurate, trouble-free reporting systems 
due to the acquisition of technically trained staff, 
creation of problem- solving procedures and development 
of WIN-IMU linkages for reporting on obtained employ- 
ment and welfare grant reductions. •> 

• More intensive and sophisticated monitoring, often 
Including comprehensive and structured joint visits 
to both SAU and sponsor units. 

• Area staff or field technicians with extensive pro- 
gram experience who provide technical assistance and 
a visible program presence In the field while also 

• serving as a communication link among local units and 
between local staff and state program leaders. 

• More open upward communications from local units to 
the ceatral office. 

• Promotion of lateral communication among local staff 
through statewide meetings, training sessions and con- 
ferences . 

a More collaborative annual planning and budgeting by 
state SAU and sponsor officials, with greater In- 
volvement of field staff. 

The organizational structure of state programs appeared less Im- 
portant to their performance than other factors. Thus, neither the size 
of state WIN programs, their organizational location within host SESA and 
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welfare agencies » nor the number of service delivery units they operated 
were related to their performance^ However » staff Intens.'.ty (staff/ 
registrant ratio) varied considerably from state to state h^d was slg«» 
niflcantly correlated with the proportion of registrants that entered 
employment • 

, Similarly, collocation of SAU and WIN coordlnatora was not found 
to be Important either to program performance or SAU-WIN coordination* 
However t the Intensity » frequency and character of their Interactions 
appeared related to program performance* 

Lastly, high and low performing programs were found both where 
WIN sponsor units were Integrated into the ES hierarchy and where WIN was 
"self-contained*'' The experience of sample states indicated that self- 
contained programs could succeed even in the face of host agency hostility 
However. WIN programs integrated in the ES hierarchy required the support 
or at least the neutrality of SESA leadership to be high performers* SAU 
coordinators in high performing programs also tended to receive at least 
moderate support from their supervisors in the state welfare agency* 

4* Local WIN Service Delivery Systems 

High performing local WIN units tended to differ systematically 
from low performing units in the way they were managed and delivered serv- 
ices to clients* WIN sponsor managers in high performing local programs 
tended to: 

a Maintain more accurate and timely reporting systems* 

a Monitor or evaluate their operations more frequently 
and intensively* 

• Emphasize systematic distributton of information and 
more frequent internal discussion* 

a Permit more flexibility regarding work rules and 
office procedures and delegate more to program sub- 
ordinates — but in combination with more. highly de- 
veloped accountability systems* 

a Exchange functions among staff and cross'-traln them 
for different Jobs* 

a Deal more directly and openly with conflict within 
the unit. 
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Services to clients also tended to be delivered diffarentiv 
high performing programs. In such programs t differently In 

• Uncooperuive clients were the subject of more exten- 
sive counseling. 

• Imparting job search skills to clients was emphasized. 

• Job development efforts were focused on the Individual 
client rather than Just on generating a large pool of 
Job orders. 

• The SAU provided extensive supportive services beyond 
child care. 

• More frequent and extensive interactions occurred 
between SAU and sponsor staff whether or not they 
were collocated. 

One of the most significant findings was the permeating Influence 
of state level variables. On issues such as program prlorltleL manageme^^ 
behavior or attitudes toward CETA. local characterlstLs were ex tensive Ty 

torfne d n "^'^ ^^^^ '^'^'^'^ that federarad:?n 

tors need not reach down to the local level m order to have an Impact on 

loca operations and performance. Rather, by influencing attitudes and 

pract ces of program and organi^atlon leaders at the sta^e level, federal 

officials can affect behavior in a l^rge proportion of local units. 

Other important findings were that: 

• WIN-ES relations were not associated with WIN per- 
formance. 

• WIN staff put little reliance on ES Job orders and 
job banks. 



WIN-IMU links were critical to WIN case management 
and reporting but were generally troubled. 

Higher performers tended to have more frequent con- 
tacts with IMU's, and a number of units had evolved 
strategies for Improving the IMU linkage. 

There was generally little WIN access to CETA train- 
ing and PSE Jobs and such access was not associated 
with WIN performance. 
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5t Improving WIN Performance 



Performance Improvement atrategies require, firat, the capacity to 

accurately differentiate high from low performing programst Recommenda- 
tions aimed at developing that capacity include: 

e Improving the retention rate and welfare grant re- 
duction performance measured • 

• Adjusting performance for environmental difficulty 
so that relative effectiveness measures take into 
account labor market and client demographic condi- 
tions beyond the control of program personnel* 

• Creating SAU effectiveness indicators* 

• Improving automated reporting systems* 

Once low performing state programs are identified, both federal and 
state personnel must have the ability to diagnose the underlying problems* 
Development of diagnostic monitoring systems is proposed that would focus 
regional federal representative's monitoring on the performance of state 
and local WIN programs and on information about administrative, managerial, 
service delivery and coordinative functions related to that performance* 
Transmission of those methods from regional to state program personnel 
and joint development of performance improvement efforts are recommended* 

Specific changes in low performing programs are suggested based on 
the pattern of characteristics found in high performers* Managerial rec- 
ommendations include: 

• Improve goal awareness and application* 

• Enhance evaluative, analytic and monitoring capac- 
ities at the state central office and area levels* 

• Expand training activities, especially around man- 
agement functions, reporting systems, financial 
systems, and welfare/employment prograr. or service 

' delivery innovations* 

• Intensify SAU-sponsor coordination and collaboration* 
Recommendations for changes in service delivery methods or emphases include: 

• Emphasize counseling and working more intensively 
with reluctant clients rather than ignoring or 
quickly sanctioning them* 
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• Place more emphasis on imparting Jobrseeking skills 
and on Job-search activities by cliencs themselves* 

• Emphasize client-oriented Job development. 

• Experiment wltu expanded institutional training for 
some clients. 

• Develop richer mixes of supportive services. 

• Improve the critical linkage to IMU's. 

Although some incentives for change already exist, incentive struc- 
tures need to be strengthened. Our proposals include a more straight- 
forward and objective performance incentive funding system, dissemination 
°" ^^'^ comparative performance of state programs throughout 
the WIN system, and, in extreme cases, the selection of alternative WIN 
sponsors. 

• While many of these suggestions might be implemented separately, 

they are also the building blocks of an integrated, sequential approach 
to improving the WIN program. The basic elements of a structured perform- 
ance Improvement program are 

• Joint development of improvement strategies by na- 
tional, regional and st^ite officials. 

• Development and application of a performance in- 
centive funding system for use at both the federal 
and state levels. 

• Development and use of monitoring guides to target 
Improvement: assistance, incentives and sanctions. 

• Periodic dJta collection and analysis of a sample 
of local WIN units representative of all WIN units 
to permit continuous monitoring of changes in en- 
vironment, organization and performance throughout 
the WIN system and to guide actions taken in per- 
formance improvement projects. 

• Structured organizational change and performance 
Improvement projects in selected state and local 
programs. 



Comparison of data from these "experimental" sites 
with data from units In the representative sample. 
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leading- to firmer conclusions on what organleational 
characteristics Influence WIN performance and what 
change strategies are most effective* 

Dissemination and general application of the knowl- 
edge derived about how to make welfare-employpent 
programs more productive. 
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PART ■ I 



PART I 
INTRODUCTION 



Part I provides a brief description of the Work Incentive (WIN) 
Program, the objectives of this research effort, =ind the methods employed 
in the study. Chapter 1 summarizes the legislative history of WIN and 
the changes in program policy concerned with providing employment services 
to welfare recipients. WIN is jointly administered by the Department 
of Labor and the Department of Health, Education and Welfare. Its unique 
bi-organizational structure is described from the national to the local 
level. This is followed by a statement of the objectives of this research 
project and the general approach we have taken to the analytic challenges 
it presented. Detailed discussion of our research methodology appears 
in the Appendices at the end of the report. 



CHAPTER 1 

THE PROGRAM AND THE RESEARCH PROJECT 



1 • Welfare-Employment Policy and WIN 

The federal government has been extensively Involved In employ- 
ment and training programs for welfare recipients for nearly two decades. 
The 1961 Amendments to the Social Security Act permitted states to expand 
their Aid to Families with Dependent Children (AFDC) program by allowing 
grants to families with an unemployed parent, usually the father, in addition 
to single-parent families. As a result, able-bodied males appeared on wel- 
fare roles in noticeable numbers, and federal attention turned to finding 
ways to get them back to work. The creation of Community Work and Training 
Projects in 1962 was intended to prepare these individuals for return to 
regular employment while enabling them to work off their welfare benefits. 
As part of this program, states were encouraged to provide social services 
aimed at the causes of personal dependency. 

This concept was expanded by Title V of the Economic Opportunity 
Act of 1963, which established work experience projects to serve AFDC 
mothers as well as fathers. Title V introduced the idea of dual organi- 
zational responsibility. Welfare agencies administered the work projects, 
training, and social services, and employment service agencies (ES) placed 
clients in jobs when they completed the program. 

The next major development occurred when the 1967 Social Security 
Amendments' replaced Title V with the Work Incentive (WIN) Program. This 
legislation institutionalized the linkage between employment and welfare 
by requiring joint administration of the new program by the Departments 
of Labor (DOL) and Health, Education and Welfare (HEW). An incentive 
formula was instituted that allowed welfare recipients to keep up to two- 
thirds of their earnings without losing benefits, and participation was 
made mandatory for some types of welfare recipients. 

Since 1967 WtN has undergone periodic legislative and policy 
changes which have shifted the amount of emphasis on instit;utional train- 
ing, direct placement in the private sector, and subsidized employment. 
The overall objective, however, has remained the same — to assist AFDC 
recipients in obtaining productive jobs, thereby increasing their economic 
self-sufficiency and reducing welfare rolls and expenditures. 



tramina T ^ 1967-1971) was on providing institutional 

training to improve clients' occupational skills. The 1971 Social Secur- 
ity Amendments changed the direction from training to immediate employment 
vjenever possible (WIN II). This legislation, often referred to as the 
Talmadge Amendments, included a mandatory registration requirement for 
all adults receiving AFDC. The only recipients exempted were the aged, 
the incapacitated, and those who lived in remote areas or were needed at 
home, to care for children under six years of age or an ill family membet.- 
nf StmM^t ^ . "^""P^^^^^ °" institutional training, at least one-third 

f ""^"iLl^s ^P^"' ^^"^ on-the-job training (OJT) and public 
service employment (PSE). ^ 

The shift in program responsibility from welfare to employment 
and training ag.^ncies implicit from the 1967 Social Security Amendments 
onward was carried one step further in the "WIN Redeslga" of 1975. Now 
clients registered with the local WIN employment and training staff rather 
than at the welfare department. They were then exposed to labor market 
information and _ an immediate attempt was made to find them a job. The 
intent was to place persons applying for AFDC into jobs and avoid their 
ever actually going pn welfare. Additional priority was put on direct 
placement of the most employable registrants and somewhat less emphasis 
on supportive services. 

Since Redesign, the national direction of WIN has gradually changed 
from maximizing immediate placements to a more "balanced" approach toward 
placement, supportive services, counseling and training. Part of the cur- 
rent balanced mission includes improving the quality of placements in 
terms of entry wage levels and job retention. 

In addition to job counseling, placement and training, the current 
WIN program model permits a variety of other services. These include 
employabillty planning, job search instruction, allowance payments during 
training, transportation to job interviews, child care for dependent 
children and other supportive services to enable an individual to become 
«"'nployed. 

In 1978 the program had about 1,6 million registrants nationwide, 
approximately 35 percent of all AFDC heads of household. They were served 
by about 13,000 local program staff located in all states, the District 
of Columbia, Puerto Rico, Guam and the U.S. Virgin mUnds. Federal fund- 
ing for FY 1979 was $388 million. 
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\ ^* Bi-Orqani?.ational Systeir 

\ WIN Is unique among federal programs in that It is jointly admin- 

Istefi^ by two different agencies at each gove.rnmental level* The program's 
bl-orga«izational structure from the national to the service delivery level 
is depict>ed in Figure I. 

A National Coordinating Committee (NCC) composed of the Assistant 
SecVetary of Labot for Employment and Training (DOL-ETA) and the Adminis- 
trator of the Office of Human Development Services (DHEW-OHDS) has statu- 
tory responsibility for WIN. The NCC delegates administration of the 
^program to a National Executive Director. The national Office of Work 
Incentive Programs (OWIN) is housed in DOL but is an integrated unit con- 
sisting of personnel from both DOL and HEW. 

This structure is replicated at the federal regional office level. 
The DOL Regional Administrator of ETA and the HEW Regional Administr'^or 
of OHDS preside over the program, while a Regional Coordinator and an 
integrated unit drawn from both departments administer it. 

In all but two states, the employment security agency (SESA) is 
currently the designated "WIN sponsor," although legislation does not 
specifically require that arrangement. A Separate Administrative Unit 
(SAU) has been established in every state welfare agency to handle WIN 
responsibilities. Unlike the national and regional WIN units, the state 
programs are not Integrated. Most state WIN sponsor and SAU adminis- 
trative personnel are located organizationally and physically in their 
respective agencies. In a few states (less than ten in 1977) » state level 
sponsor and SAU staff are collocated, but even in those cases they are 
organized as two separate units reporting to separate managers. 

Below the state level, the pattern of dual organizational respon- 
sibility Is continued In all but a few cases. Most local WIN service de- 
livery systems Involve separate SAU and sponsor units, even though they 
are sometimes collocated. Howler, the linkages between these pairs of 
units and from each unit to its host welfare or employment security agency 
vary considerably, as Parts III and IV of this report explain. While 
national policy Is that WIN should exterd to as many AFDC recipients as 
possible within budgetary limits, the state sponsor and welfare agencies 
have the authority to decide what areas of their state will be covered. 
In 1976 over 90 percent of all AFDC cases were in counties served by a 
WIN program. 

The current bl-organlzatlonal character of WIN reflects a per- 
ception', evolved over two decades of experience, that putting welfare 
recipients to work is a complex and varied task requiring both emplojrment- 
felated and social services. Joint administration has, however, posed 
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special challenges to participating organizations and personnel. The 
priorities, perspectives and concerns of DOL and HEW are often very dif- 
ferent, as are those of state or local employment security and welfare 
agencies. Divergent organizational goals, program models and even phi- 
losophies must be considered. Questions of allocating program resources 
and authority between the two partners must be resolved. Issues of inter- 
orgaulzatlonal communication and coordinated service delivery must be 
continuously faced. At a time when attention has turned Increasingly to 
the need for closer coordination among all kinds of federal agencies and 
programs, the experience of WIN should be Instructive. 

3. Research Ob .^ e c tives 

In his review of WIN research, Leonard Goodwin noted that most 
of the studies conducted In the past have focused on the characteristics 
of recipients and their Interactions with the job market or with public 
programs.* He argued that. 

Such a focus was eminently reasonable. When WIN was 
Initiated . . . , there were serious unresolved ques- 
tions about the characteristics of welfare recipients 
in relation to their participation in the work force. 
It was not clear that recipients shared a strong work 
ethic or what other factors affected their trainabil- 
Ity and work effort. Hence, much of the research 
focused on the labor force activity of welfare per- 
sons and the way In which the WIN effort affected that 
activity. - 

As a result of that research program, much has been learned about 
the impact of WIN and other government actions or policies on welfare 
recipients' employment experiences, attitudes and behavior. 

However, Goodwin also notes that little research has been conducted 
on other important aspects of the WIN program, among them the administrative 
and service delivery systems.** "Lack of a picture of what really happens," 
Goodwill asserted, "at different levels of WIN operation, within and between 



*Goodwin (1977) , p. 3. 

**The few previous studies that focused on the WIN service delivery 
system either were conducted in the early Seventies before the major modi- 
fications of WIN 11 occurred or concentrated on specialized innovations 
such as provision of services through vouchers; see Reid et a l. (1972) 
and Richardson (1973). 
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the several systems, makes it difficult for policymakers and members of 
other systems to understand what is behind statistical results, ... and 
what could be done to improve the situation." 

^„,nro„. lu^ 'research in this report is intended to help understand and 
improve these administrative and service delivery systems.* Our approach 
Is to seek to learn what differentiates high p erforming .WIN programs frnm 
low performers . Such an approach also permits us (1) ?o describe the or- 
ganizatlonal and managerial arrangements which translate WIN policies into 
flrtTrrlt^t\^V. '^""'''^ environmental, political and bureaucratic 
!molemLt«Mn ^^"^ P'^oductivity . and (3) to suggest ways in which 

implementation of the program might be Improved. 

Although our principal concern is with the administrative and 
n!I^ rn^?^. systems, recipient demographics and labor market conditions 
play a critical role. We treat recipient and labor market characteristics 
as environmental factors that define the conditions under which state and 

u?M°^'^"' operate. These factors are beyond the control of state 
or local WIN programs, yet they influence program performance. To focus on 
the impact of organization and management on performance, we first have to 
adjust performance data for the effect of these external influences, 
turthermore. we use data on program participants' success in obtaining 
employment and decreasing welfare dependency-measures consistent with 

e?fectiielL'°f ^SJ^^'r'""^' "''"'^ J^^Sing the relative 

effectiveness of state and local WIN programs. 

This research takes current national policy on the WIN program 
as a given. We do not address the relative effectiveness of WIN compared 
to other past, present or proposed welfare-employment programs. However, 
this study can provide insights for policy makers attempting to reform 

TTnriV ^^"'^^^^^ services agencies and employment programs. 

A local service delivery system to provide both supportive and placement 
services will still be necessary. WIN has been dealing with these linkage 
issues for a decade now. and much can be learned from Its experience. 

Our approach has focused on uncovering the interactions which may 
occur between the WIN environment, the WIN organizations, and the produc- 
tivity of those organizations. A simple model of those interactions is 
presented in Figure 2. in the diagram, environment is hypothesized to 



*Other studies have recently been undertaken that focus on specific 
functions or aspects of WIN such as unified budgeting, job development and 
SAU organization; see Farb .1978). Lewis (1978) and Entis (1979). 
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directly affect both the level of performance and organisational struc- 
ture, process and behavior. Those organizational characteristics. In 
turn, nay act to Influence the level of WIN p.erformanc«. This kind of 
interrelationship between environment, organization and productivity has 
been observed In various kinds of public and private sector organizations 
and Is widely discussed In the literature on organization behavior. 
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Figure 2 

General Model of Environmen t.. OrganizAtlon and Perfr.rm«nro 

in Fl^ur?l%"^l" ^^^"^ o'^ganlzed around the general framework shown 
m Figure 1.2. Thus, Part II explains how performance was defined and ' 
fo^i"" the influence of environment on state and locaHlN progla^'^per- 
ITaT ^! environmental factors treated include not only economi? 
?nfl^enn!r'''\'°"^'f'°"^ ^'""^^ political and bireauc^tic 

Lir!r '/""'^ ^^^^'"^ officials, state civil service systems and 
federal regional offices.* ana 

The next two parts focus on the organization Itself. Part III 
considers the organization of state WIN programs. It discusses overall 
program structure, functions of the WIN sponsor and SAU central offices 
management style and attitudes, and staff characteristics. Part IV ana^ 
lyzes the structure and processes of local SAU and WIN sponsor service 
delivery units. It also examines the linkages between local unitrand 
a^U'sr°?nrr*>,^"''^ ".i^f employment service. Income maintenance units 

lL^:citL°:L'^j:h\\'iutfioT^"' '"^^^"^ ^^^^ ^^--^ 



In f 



*A separate report addresses the WIN federal management system 
uller detail. See Chadwin (1979). 



•v. 



11 



/ • 



Part V uses the Information presented throughout the report to make 
suggestions aimed at improving the implementation of welfar6-employment 
programs such as WIN. It is followed by appendices and a bibliography. 
Appendix A presents our methodology. It explains our conceptual framework 
and describes how we defined terms, categorized phenomena, selected our 
study aamples and collected and analyzed different types of data. It 
discusses the uses and technical limitations of different parts of our 
analysis. That analysis Included environmental and performance data on 
all state WIN programs for a three-year period and on all 214 local WIN 
units in our lO-state study sample. The organizational, managerial and 
political characteristics of those 10 state WIN programs and of 43 of 
their local units were the subject of Intensive Interviewing and other 
on-site data collection. 

Appendix B provides a detailed technical discussion of our analysis 
oE the Impact of socio-economic environment on state and local program per- 
formance. Appendix C presents an outline of the interview guide used in 
field research at the local, state and regional office levels. In all, 430 
individuals in WIN. In host agencies or In other organizations which Interact 
with WIN were Interviewed. 
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ENVIROiNMENT AND PROGRAM PERFOR^NCE 



PART II 

ENVIROiNHENT AND PROGRAM PERFORMANCE 



The iSooio'eaonomiQ environments within which WIN programs operate 
si.jnvfl(?antl-j influence theiv performanoe levels. Measures of that performance 
were identified through anal'jsis of ■ the WIN Allocation Formula, program documents 
and interviews or aurve-js of program officials. 

Four main performance measures were identified that reflect the current 
hnlayyyd mission cf WIN to find j'ols for as many registrants as possible while 
also inareasiyij the wage level and duration of those jobs. These measures were 
standardized to permit state-to-state comparisons and were statistically adjusted 
to take into aa^-ounc differences in labor market and client difficulty. The 
foui' principal measures were: 

• Number of Job entries per staff, 

• Average Job entry wag^, 
0 Retention rate, 

• Average monthly welfare grant reduction. 

Programs were identified as high performers if they performed better than 
expedited given their socio-economic environment on a composite index of these 
four measures. Those that performed worse than expected were identified as 
low -performiirs. Both high and low performing programs were selected for more 
detailed study, 

Multivariate statistical analyses showed that a high proportion of the 
variance in state and local WIN performanoe on^ these measures was associated with 
differ .'noes in .t'neir socio-economic environments. Analysis on 214 local units in 
ten states revealed that labor market and demographic variables accounted for 
about one- third to one-half of the difference in performance among local WIN 
programs. Thus, for example, 62.1 percent of the variation in average WIN local 
Job entrg vaje levels was attributable to the combined effect of five factors— 
prescKee of low wage industries, average employer size, poverty population, male 
registrants, 2nd local employment growth, 

.hir findiyigs about the impact of socio-economic environment on 
p.'fformance have important implications for resource allocation decisions on 
the naii mal, regioml and state level. They suggest the possibility that 
alUyuti.y: formulas might be developed that provide performance incentives 
while j.ikiyig in^o account the relative difficulty of labor market, and demo- 
graphic' c:>nditi(ms facing different state or local WIN programs. 



iJutu :m the ojoriomio and olient-demo.jmvhio factors affeotina 
V.v:ovmay,>: .^,n M..' be uacjut in evaluation ov management analysis because 
I-^^I?/-'' -'^^-f ?^ ^^^'■■i^^ deai>Ue diffevenaea in environment. The 
mtomatton m:, also asstat pUmnuuj and looational deaisiona, ainoe it 
ui<^.,v,u.' :j.ijs tv preui^t more pre^ieelj what potential porfomianoe can be 
expeotod jrom WL\' operations in dij-erent Hnd^ of comluniUes. 

Unlike ^:'.jLj>-eoonomio environment, differences in political- 
bureaucratt.^ envt roy'^ent were not shorn to be associated .with variations in 
/.sir''"""' ^VVV.c..'6-' impact on state and local progra^n 

./.-^■^^^■•n.^Z:/ qu^e Umited, although the regions were quite 
,\.T''l V participated in state plan development, 

^oyuucced review,, and^ interacted with states in- their regions, 

:^tate Uvel elected officials were generally unaware of and 
uninterejte,. in ^x.V. With one exception their impact on program policy was 
^^.reme.j .i»iit^u. ^ Lobbying groups almost wholly ignored WIN in our ten 
<^cuuy jiatcj. legislative and executive review of WIN budgets were 
jeneraUy cu^^jor ,, ydthough in several states they resulted either in 

w " ^^^"''r.:^''^ ^'^''^^ limited or increased Title XX funding being 




tJ'^J''^" t <'^;:-i;^'j>;^^-' and political intrusions. Similarly, the responsive- 
n...h., ^ ^.-xic^i.ity oj support systems such as administrative service 
ugenci.-o .i>u stale personnel departments varied across the sample hut were 
-'■'o ao-ov--,'^. -J I in differences in performance. 
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INTRODUCTION TO PART II 



Performance is the keystone of our study* Our research is 
directed at Identifying those organizational characteristics that are 
systematically associated with high WIN performance* Its ultimate objec- 
tive ts to develop strategies for improving performance by introducing 
changes In the way programs are administered and operated* How perform- 
ance Is defined and measured can have a major influence on what are iden- 
tified as effective ways of organizing state and local programs* 

However, performance is likely to be affected by other factors 
external to the WIN program — factors beyond the control of administrators 
and st^ff* Some of these environmental variables— socio-economic ones— can 
have a' direct influence on WIN performance* They can make the job of 
providing supportive services , improving registrant employability and 
placing registrants on jobs easier or harder* These factors vary from 
state to state and local community to community* It is therefore likely 
that performance. levels will vary, too* State and local operations in 
relatively favorable economic and social settings should have higher 
performance levels than those in less favorable ones* Chapter 3 explains 
how we approximated the influence of socio-economic factors on performance 
and took this Influence into account in determining the relative effec- 
tiveness of state and local programs* 

Another set of "environmentv 1 variables" have indirect influences 
on performance* They cannot directly affect the output levels of the 
program, but they' can influence the organization itself and, through it, 
Impact on performance* These include political or institutional environ- 
mental variables such as elected officials and their appointees, civil 
service commissions or public employee unions* This type of environmental 
factor will be addressed in Chapter A* 

Figure 3 graphically presents the hypothesized relationship 
between certain environmental factors and WIN performance* The shaded 
portions of the model are the subject matter of this Part* 
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CHAPTER 2 

PERFORf^NCE AND SOCIO-ECONOMIC Ei)IVIRONMENT 

r 



This chapter describes the determination of key performance 
measures used throughout the study to assess program effectiveness and 
our findings on the effect of socio-economic variables on WIN per- ' ^ 

formance levels* The four sections that follow discuss (1) program petr 
formance measures used In this study» (2) the effect of soclo«-economlc 
environment on state productivity, (3) the effect of environment on local 
productivity, and (A) the general relationships among the environmental 
and performance variables* A more detailed discussion of these Issues 
Is presented In Appendix B* 

!• Program Performance Measures 

The performance of public programs can be defined In many ways* 
This section describes the process we followed In Identifying key WIN per- 
formance measures, their role In this study, and their limitations* 

Performance Definitions 

The purpose of this study was to examine characteristics 
of high and low performing WIN programs* We operatlonalized "perf orjiance" 
as it is defined by the national program* The key performance measures 
in WIN were identified by three methods: 

• Analysis of the components of the WIN Allocation 
Formula to Identify its performance elements and 
their relative importance in determining funding 
levels for state programs* 

• Content analysis of national program documents to 
identify which performance measures are emphasized 
in communications to the field* 

• Interviews with national and regional officials and 
surveys of state program administrators to obtain 
their perceptions of program objectives** 



*A description of the allocation formula and our analysis of this 
formula are presented in Appendix B* A detailed discussion of all three 
methods of analysts appears in Mitchell, et al * (1977a)* 
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Analysis of the discretionary portion of the allocation formula 
provided the initial identification of performance indicators and their 
relative priority. Using computer simulations of the formula, we were able 
to Identify the relative impact of performance factors on the amount of 
lA^''l1l^°1^y ^""'^^ allocated to states.* The four most important factors 
identified by the simulations were; job retention rate; job entry Wage 
rate; number of job entries; and average monthly welfare grant reductions. 

Interviews and surveys were used to verify these findings as well 
as to identify the degree to which goal consensus existed at different 
levels of the program. Officials in the WIN national office, all regional 
coordinators and all state WIN sponsor coordinators were asked to define 
the objectives and goals of the WIN program. We also inquired about the 
performance measures they used to assess their programs and the relative 
importance they attached to each measure.** 

One additional step was required before using the above four 
performance measures in our research. Two of the four measures— number • 
of job entries and monthly welfare grant reductions— were significantly 
affected by the relative size. of state WIN programs. For example, could 
we meaningfully assess relative performance by comparing the absolute 
number of job entries generated In California to those that occurred 
In Mississippi? Similarly, what equity would there be in comparing 
California s ,£ross welfare grant reductions to those of Mississippi?*** 



*Elght factors are used in the WIN Allocation Formula; job 
retention rate; job entry wage rate; number of job entries; average monthly 
welfare grant reductions; penalty for poor reporting; dollar cost of the 
state program; potential number of WIN registrants; and the average monthly 
welfare grant. ^ 

**Tlme and cost considerations led to a decision to collect Informa- 
tion from only one respondent per state at this time. During our field work, 
data on similar items were collected from the state SAU coordinators in our 
sample states, 

***More than the program size factor limited cross-state comparisons. 
The^average monthly welfare grant In California for 1977 was $302, compared 
to 47 in Mississippi. Thus, placing a registrant In a job that removed 
him or her from welfare completely in California would result In a welfare 
savings 6.4 times greater than a similar placement in Mississippi. One 
way of resolving problems arising from both program size and welfare grant 
size is to compare actual welfare grant reductions to potential welfare 
grant reductions. The latter is, in effect, the saving that would occur 
tt every WIN registrant were removed from the welfare rolls. This is, in 
fact, how we have standardized welfare savings data across state programs. 
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To permit meaningful compatiaona we had to atandardlze these 
measures. Job entry performance thus became a productivity measure- 
job entries per staff. Welfare grant\ reductions were standardised by 
dividing gross welfare saivings by the product of the number of regis- 
trants in a program and that state's average welfare grant. This created 
an actual-versus-potential type performance measure. 

Standardization was also required for a third measure— job 
entry wage rates. Statistical analysis indicated that WIN job entry 
wage rates were systematically related to state prevailing wage rates.* 
Thus, it would not be meaningful to compare job entry wage rates in 
Alaska, where the prevailing wage was $8.21 in 1977, to those in low- 
wage states, such as North Carolina with' a prevailing wage of $3.80. 
We standardized this measure by dividing the average WIN job entry wage 
rate by the prevailing wage rate. Thus, it measured the degree to which \ 
WIN wage rates approached the state (or local) labor market's prevailing 
wage. \ 

The remaining performance measure— retention rate-required no 
standardization. It is currently defined by the WIN program as the propor- 
tion of those placements expecred to last 30 days or more that actually last 
that long.** 



*Average hourly earnings of workers on manufacturing payrolls were 
used to standardize the job entry wage measure. This standardization was 
chosen because WIN job entry wage rates were significantly related to pre- 
vailing- wage rate (average hourly earnings of production workers on manu- 
facturing payrolls), with correlation coefficients ranging from .718 to 
.785 for the period 1975 to 1978. Later multiple regression analyses were 
conducted using this standardized measure and also using an unstandardized 
measure (but with prevailing wage as an Independent variable). No signi- 
ficant differences between the two approaches occurred in the statistics 
or in their power of "explanation.!' 

**The definition for retention rate has changed during the past four 
years, which caused some analytic problems. A change from FY 1977 to FY 
1978 caused immediate reporting changes in the states. Both definitions 
were based on the entries expected to last at least days. But in 1977 
retention was measured as the number of persons contacted and still on the 
Job compared to the number of actual contacts made. Since FY 1978, retention 
has been measured as the number of persons contacted and still on the job 
after 30 days compared to the number of entries originally expected to last 
30 days. The federal computer program accompanying this change was in error, 
and carry-over counts from the previous fiscal year caused considerable 
Inconsistency in reporting. These technical problems plus conceptual issues 



Table 1 presents the standardized performance measurei that were 
used In this study and the priority weights for each. The weights were derived 
from the simulation analyses of the allocation foirmula. The table also gives 
the >data sources for each measure* 

Some clarifications are necessary about these performance measures. 
First, the performance Indicators (In their unstandardized form) were 
those stressed as most Important in the allocation formula and in WIN 
national office policy statements. They are not policy Judgments that 
we have made. V 

Second, the performance measures address different tilmensions 
of the same phenomenon — the acquisition of jobs by WIN registrants. Job 
entries per staff is largely a measure of quantity . Retention rate and Job 
entry wage rates describe the quality of the Jobs in which WIN registrants 
are placed. It is reasonable to expect that the quantity and quality 
objectives work against each other. Increasing the number of WIN regis- 
trants placed could lead to emphasizing "quick and easy" Job entries — 
relatively low paid Jobs with high turnover rates and low job security. 
This runs counter to a quallty-of -placement goal. Conversely, emphasizing 
quality — making placements that last 30 or more days and at relatively 
high wage rates — requires a more labor-intensive placement effort. This 
extra effort means fewer total Job entries. 

Although retention rate is the most heavily weighted factor in the 
formula, it is not to be assumed that placements are not Important. 
Naturally, retention cannot be maximized unless a client is placed. The 
weighting merely indicates that a quality placement (higher wage, longer 
duration) is more Important than Increasing the numbers of placements. 

As the analysis that follows shows, state WIN agencies that are high 
performers on the placement quantity measure are not high performers on 
the quality measures. Few state WIN programs are either high or low per- 
formers on more than one of the four measures. Thus, readers should bear 
in mind the balanced mission of WIN. High performers generally try to 
balance their performance on both quantity and quality measures. Low per- 
formers may do well on one of thede measures, to the detriment of others. 

It is also evident that tne four measures address program per- 
formance at two different levels* The placement, wage and retention indi- 
cators measi/re outputs directly attributable to local WIN unit workers. 
Local staff either make direct placements or provide labor market knowledge 
and an "incentive" that stimulate registrants to find their own Jobs. 



♦♦(continued from preceding page) concerning whether retention rate 
as now reported Is a realistic measure of overall quality of WIN job entry 
activity are discussed in detail in ^pendlx B. 



Table 1 



St andardized WIN Performance Measures. Dat a Sources for Measures and Weights 
— ~~" Derived from Analysis of WIN Allocation Formula 



Standard! std 
Perfonianct 
Mca&urca 



1, Katantlon Rate 

2. Entry Wage Rate 
Prevailing Wage Rate 



3, Huffber of Job Entries 
Staff Poaitlons Paid 



4. AveraRe Monthly Welfare Grant Reductiona 
• Average Monthly Welfare Grant Coats 



Data Sources 
for Heaaurea 



Win Allocation Formula Table iM 

WIN Allocation Formula Table 6.i'/Avarage 
- urly gross earnings of production 
workers on manufacturing payrolla 
(Employment and Earnings, BLS) 

WIN Allocation Formula Table 5, Col, 7,l//Coat 
Accounting System R eport 96 

WIN Allocation Formula Table 5, Col, 3.*//WIN 
Allocation Formula Table 6» Col, 6 x Table 1» 

Col. 3.1/ 



Uaighta Derived from 
Analyaia of WIN 
4 1lQcation Formula 



Abaolute 
WeiRhta 

14.97 

B.31 



7.53 
7.47 



Percent of ^ 
Total WeithW 

39.1IX 
2i.7XX 



19.67X 
19.5IZ 



"C^l. 7 for rY*76, Col. 11 for FYW7 and Col. 3 for FY*78j ^ wi a r«> A f«r W»7a 

»*True" weighted average uaing Cols. 3, 4, 6 and 7 for n*e '76 and '77$ Table 4, CoX. 4 for FY 78. 
Table ^, Col. 3 for FY«78. 
Table 3, Col. 2/Col. 1 for FY»78. 
Tible 7» Col. 3 X Table 1» Col. 3 for FYW8. 

Absolute weights total to 38. 28. so that 14.97 ia 39.111 of total.. 
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On the other hand, welfare savings are largely the result of the quantity 
and quality of these Job entries.* H»«n''ity 

Lastly, WIN performance along dimensions other than these four 

measures was not ignored. In our search for measures of program output 
n^n^r^r performance variations among state and local 

programs, we tested the relationship of other available activity measures 
to these four measures. In addition, we sought to identify activity level 

?r^u?r "^!^' "^^^ ^" ^"'"'^^ SAU performance measures.** 

ihe WIN program does not currently include SAU activity levels in its 
measurement of program performance. Developing SAU indicators would re- 
quire careful examination of how SAU and WIN sponsor activities relate to 
_ach other and to overall program objectives. SAU measures cannot be de- 
fined separately from sponsor measures. The steps that would be necessary 
m developing indicators for SAU performance are discussed in Chapter 14. 

~* Effect of Socio-Econo mic Environment on State WIN ProducMvify 

This section briefly describes (1) the procedure used to analyze 
the effect ot social and economic variables on state WIN performance, 
2) the results of that analysis, and (3) how we applied those results 
tu selecting study states. A more detailed discussion appears in Appendix 



Re lationships Between Socio-Economir Factors and state Perfnr.n«nP. 

. ^ "l"^^" hypotheses presented in Chapter 1 was that enviro- 

mental variables had a significant direct effect on WIN performance 
levels. Programs in relatively favorable environments were hypothesized 
to perform better than those in relatively unfavorable settings. That 



*The level of reported welfare savings can also be affected by 
other factors. Programs that gave priority to the reporting of welfare 
grant reductions by iMU's are likely to have highe r reported' savings! 
Also, differences among state and local programs on what constitutes WIN- 
related welfare savings can have a similar effect. Some state and county 
IMU s might report all reductions related to WIN registrants, even those 
caused by windfalls (inheritances, etc.) or marriage. Others might be 
very restrictive. They might report only those welfare reductions due 
to direct placement by WIN staff, refusing to give WIN credit for those 
emplo^ent')!''"^ ^""^ registrants finding their own employment ("obtained 

**SAU activity levels were included in analysis whenever possible. 
Tilts was hampered by two factors: (1) the lack of comparable data on 

r^n's'n ^''''^^ activity measures and (2) the questionable 
reliability of th.> data that were available. These factors and hypothe- 
sized links between SAU Items reported in Parts III and IV and overall 
program performance are treated In Appendix B. 
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Is, S^ato and local programs In certain types of labor market areas ob*- 
vlously have more difficulty placing registrants into Jobs. There may 
be very little choice in the Jobs that are available. Even the best WIN 
staffs cannot place registrants unless there are Jobs in the community* 

To. identify socio-economic conditions or demographic character- 
istics of WIN registrants that might have a significant effect on WIN 
performance, we first reviewed previous research. These studies sug- 
gested possible relationships between registrant demographics. WIN services 
provided, and program performance. In addition, we developed hypotheses 
ourselves about how WIN performance might be affected by economic and 
labor market conditions as well as a few relatively fixed program charac- 
teristics for which reliable data could be obtained. Appendix B presents 
the factors for which data were available at the state level, our rationale 
for Including them in the analysis, and the data sources used to operation- 
al Ize them. 

To test the hypotheses we first examined these environmental 
variables and performance measures using blvarlate correlation analysis. 
This analysis simply compared the values of two variables for each state 
program— one an environmental variable and the other a performance measure. 
It showed whether, acfoss all state programs, there was a discernible and 
significant relationship between any two variables. Did the values of a 
performance indicator consistently Increase or decrease as the values of 
an environmental variable Increased? This procedure was repeated for each 
environmental and performance variable. Blvarlate relationships were simi- 
larly examined among environmental variables and among the performance 
Indicators. In this way we were able to Identify those socio-economic 
variables that were significantly related to different WIN performance 
measures. Data were analyzed separately for three 12-month time periods. 
These time periods were (1) CY 1974, (2) CY 1975, and (3) April 1976 through 
March 1977. They corresponded to the three reporting periods used for WIN 
allocations for FY 1976, FY 1977, and FY 1978 respectively. Correlations 
among environmental variables and performance measures were examined for 
each of the three time periods, based on data for 51 state programs.*. 

Table 2 shows those factors that proved to be significantly 
correlated with each performance Indicator at the state level and whether 
the relationship was posltlve(+) or negative (-) . As the table shows, 
each of the four measures was associated with different environmental 



*For a more technical explanation of all statistical procedures, 
see Appendix B to this report and Mitchell, et al . (1977b). For complete 
correlation matrices for performance and environmental factors for each 
ot the three years, see Nightingale and Mitchell (1978). 
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TablQ 2 



Soclo-Economlc Factors Slanlf Icaatl v Related to Each. Performance Maaaure 
at the Stat e Ltvel for FY 1976. FY 1977 and FY 1978* 



Positive 

Factors 

(^) 



Job Entries 
Per Sponsor Staff 

Labor force partlci* 
patlon rate 

Prevailing wage 



Proportion of WIN 
registrants that 
are male 



Proportion of WIN 
registrants with 
12 or more ye^rs ' 
schooling 



Welfare 
Grant 
Reductions 

Prevailing wage 



Growth in non- 
agricultural em- 
ployment 



Proportion of WIN 
registrants that 
are male 



Proportion of WIN 
registrants with 
12 or more years 
schooling 



Retention 
Rate 

Entry level salary 
for counselors 

Proportion of WIN 
registrants with 
12 or more years 
schooling 



Job Entry 
Wage 

Population 
density 

Unemployment 
rate 



Proportion of 
employment in 
lowwage. indus- 
tries 

Entry level 
salary for 
counselors 



Proportion of 
WIN registrants 
that are male 



Negative 

Factors 

(-) 



Proportion of popu- 
lation below poverty 

Proportion of WIN 
registrants that are 
non-white 



Population den- 
sity 

Large metro 
areas 



Prevailing wage 



Unemployment rate 



Unemployment rate Proportion of WIN 

registrants that 
are non-white 

Average employer 
size 

Proportion of em- 
ployment in low- 
wage industries 

Proportion of WIN 
registrants that 
are non-white 



♦Ail relationships are statistically significant at the .1 level or higher for at 

\Ta a t» o 



lease cwo vears 
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factors* Also, some environmental factors were positively related to one 
per|/rmance measure and negatively related to another. For example, as 
population density Increased, welfare savings decreased, but job entry wage 
increased* Correlations, therefore. Identify the relationship between two 
factors* 

However, vblvarlate correlation analysis does not provide an under- 
standing of the. multiple environmental Influences on WIN performance found 
In real world operations* The values of one environmental variable might 
be affected (or offset) by other environmental variables* Therefore, we 
next used multiple regression analysis to Identify the linkages among 
environmental variables and WIN performance measures* In this way we were 
able to more thoroughly test the hypothesized effects of environmental 
factors* What were the combined Influences of socio-economic variables on 
different WIN performance measures?" What groups of factors best "explained" 
variation In a performance measure among state programs? 

For each of three years (CY's 1974, 1975 and 1976), step-wise 
multiple regression was used to analyze the relationship between each 
performance measure and the env.lr'^nmental factors* The results of this 
analysis are presented In Table 3* The environmental factors shown best 
"explained" variation In perfopance at the state level for each measure 
and each year* The adjusted R under each set of environmental variables 
shows the proportion of the variation In performance among states that was 
attributable to that set of environmental variables* Thus, In , the case of 
average WIN job entry wage, two variables taken together (proportion of 
employment in low wage industries and proportion of WIN registrants that 
are male) explained 30*5% of the variation In performance In FY 1977 and 
21*7Z In FY 1978* 

Several Important results are apparent In Table 2*3* First, the same 
sets of factors show up as the most powerful explainers of the same perform- 
ance measures each year, with only two exceptions** The linkages between 
performance and environmental factors are, for the most part, consistent 
over time* Second, the environmental factors that have the greatest 
Influence are not the same for each of the four performance measures* 
Third, certain performance Indicators seem most Influenced by labor market 



*The recession of 1974 evidently seriously affected the number 
of job entries per WIN staff for FY 1976 allocations* None of the asso- 
ciations which were strong In FY 1977 and FY 1978 held up for FY 1971* 
Second, the FY 1978 allocation formula changed the method of calculating 
retention rate, and this appears to have brought different factors Into 
prominence as explainers of retention rate for FY 1978. 
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Table 3 



....T^^ ""^.^ '^^^ Signific antly Explain 
Variation m state WIN Performance. FY 1^7fi, j^^-TofT^v 1973 
(Results Qt regression analysis of stat e level dlta) 



^' factors Affecting Job Retention Racp 



Explanacory Variables 

[FY 19 76 ' — [ 

Metro, population 
Highly educ. registrants 
Counselor salary 
■ [Adjusted R2-.279, N-51] 

[FY L97 7 

Highly educ. registrants 
Counselor salary 
Unemployment rate 
(Adjusted R2-.359, n»51] 



IfY 1973 



Minority registrants 
Lowwage Industries 
Labor -orce partic. rate 
[Adjusted r2=.220, N=51j 



Cumulative 
r2 



.082 
.225 
.309 



.137 
.290 
.385 



.083 
.169 
.252 



Beta coef. 
(and direction F-ratio 
of association) (significance^ 



-.41425 
.47337 
.29960 



.48035 
.43752 
.31049 



-.36374 
.33068 
.29228 



10.271* 
12.593* 
5.463* 



16.743* 
13.793* 
7.241* 



8.044* 
6.682* 
5.219* 



2- Factors Aff ecting WIN Job Entry Wa^ f» R;,^a 
(average entry wage/state prevailing wage) 



Explanatory Variables 



m 1976' 



Population density 
Lowwage industries 
[Adjusted R*^«.207, M»51J 



FY 1977 



Lowvage industries 
Male registrants 
[Adjusted R-=.305, 'n'»51] 



I9rs 



Lowwage industries 
Male registrants 
[Adjusted R-=».2i7, N'=5lJ 



Cumulative 
r2 



.145 
.224 



.152 
.320 



.137 
.234 



Beta coef. 
(and direction 
of association) 

.32981 
.28608 



.44650 
.41391 



.38517 
.31109 



F-ratio 
(significance)! 



6.380' 
4.800 



13.516' 
11.615" 



9.078' 
5.922^ 




two-tailed F-test at 5Z critical value (5.424) 
*i>i4niticaat tor one-tailed F-test at 5Z critical value (4.085). 
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Table 3 (continued) 





Factors Affecting WIN Job Entries oer Soonsor ^q^Affl/ 




FY 


• 

Explanatory Variables 


Cumulative 


Beta coe£. 
(and direction 
of association) 


F-ratio 
(significance) 


1977 










Minority registrants 

L^hor forCP n:irfi'^ raf^ 

[Adjusted R2-.2'rj, N-50J 


.205 
. 240 


-.43413 
.18823 


11.297* 
2.124 


FY 


1978 










Minority registrants 
Labor force partic. rate 
(Adjusted R^«.231, N-51] 


.176 
.248 


■•-.38682 
.27036 


9. 412* 

*♦ • V 7 W 


1 
1 
I 


D. Factors Affecting 


Standardized 


Average 






A Monthly Welfare 


Grant Reductions 




1 
1 

r 

! 

IFY 


V 
\ 

Explanatory Variabiles 


Cumulative 
r2 


Beta coef. 
(and direction 
of association) 


F-ratio 
V signiiicance j 


1976 ^ 








i 
1 


Average employer size 
rrevaiiing riourxy wage 
(Adjusted R-».345, N-51] 


.226 
.359 


-.51498 
.36652 


19.609* 
9.933 

■ 


■FY 


1977 








1 


Average employer size 
Prevailing hourly wage 
[Adjusted R'^-.429, N-51j 


.231 
.441 


-.51191 
.45928 


22.406* 
18.035* 


FY 


1978 










Average employer size 
Prevailing hourly wage 
[Adjusted r2».254, N»51] 


.237 
.270 


-.49684 
.18242 


16.174* 
2.181 



1/ No data is presented for FY 1976 since no set of explanatory factors yielded 
F-tedCs at or above the 5% critical value. 

*Significanc for two-tailed F-test at 5% critical value (5.424). 

**Signif icanc for one-tailed F-cest at 5% critical value (4.085). 



29 



conditions, while others are more sensitive to registrant characteristics 

?enitJcs ?oir?h"" -ost heavily influenced by reglstr.n? charac- 

of%ho n!:f/ '^^^ environmental factors explain 21 percent to '43 percent 
of the performance variation among state programs. percent 

Identifying High an d Low Performing State Programs 

to whlch'^Lh""^^^"^ regression equations not only estimated the extent 
menf 5hev «l^n socio-economic environ- 

?n . provided a way to control for socio-economic differences 

tls llll'tl llfiLT'T' '.'"f -Sression equation for each mew" 

given thp If ? expected level of performance for each state. 

iZlrrlA ^""T conditions in that state. By comparing 

exfiecie^ performance to actual performance, states were identified that 
were doing better or worse than expected 'on each performance measure.* 
L f''"' difference between estimated expected perfomance 

or^anl^M l«8«ly due to differences in managerial and 

::L^^^^:is"of ou?^fi^:id1:Ll.^;:: ^'-^ ^^""--^ course, the 

to What '^iTf,^^^^^^^^^^^^ ^^J^:^ 
be expected to do. given their environment. This ratio was used to derive 
performance scores on each of the four measures. To obtain an overall 

Srcom'^in^d """T/"' °' individual indicators had to 

be combined. After consultation with national WIN officials, an overall 

performance index was created in which each indicator was weighted as in 

the discretionary portion of the WIN Allocation Formula.*** 

w selection of study, states considered the overall performance 

staL^'^ ^' ^"'^ ^^^Pl« included't^rer 

year T^o other .l^r '"ITT ''"^ '"^^ ^^''^ performers each 
year. Two other states had shown improvement over that period and were 



nprfn.^/ 1 ^^^^^^^^ ^""^ Mitchell (1978) for actual and estimated 
performance levels for all states for the three years analyzed. 
wn,.iH 1 "sidual (actual performance minus expected performance) 

errir. H M T ""^^^"^^^^^d environmental factors, to measurement 

errors and biases in the data used, and to random shocks affecting programs. 

***See Table 2.1 for the policy weights as derived by simulation 
analyses of the WIN Allocation Formula. This part of the foLula is/in 
effect, a statement of current national performance priorities. For 
explanations of the development of the performance index and the technical 
MuT[[r^!^n"7b^)?^ '''' performance, see Appendix B and 
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clearly high performers in the most recent years. The last two were low 
performers with consistently declining performance.* During the course 
of the study, however, one of the original high performers experienced 
a drastic decline in productivity (based on FY .1979 performance data). 

,3. Effect o f Socio"Economic Environment on Local WIN Productivity 

The local sites visited within the ten states were selected in a 
manner similar to the method used for state selection.** In states where 
the number of local projects permitted statistical analysis, regression 
equations were used to estimate expected performance. This was then 
compared to actual performance in the same type of procedure used at the 
state level. Final selection of sites was made after consultation with 
the WIN sponsor and SAU coordinators in each state, to confirm the high 
and low performer status. 

The process of selecting local sites to visit resulted in a data 
base of all local WIN units (a total of 214) in the ten study states. 
Analysis similar to that described in the preceding, section was then con- 
ducted with this local level data. The purpose was (1) to identify high 
and low performing local WIN units across the ten states and (2) to verify 
and further explore the relationships between environment and program per- 
formance indicated by the state-level analysis. This section briefly 
describes the analysis and our findings. 

Relatlonshlj&s Between Socio-Economlc Factors and Local Performance 

Following field work, correlation analysis was conducted as the 
first step in identifying associations between environmental variables 
and local unit performance. Table 4 presents those variables that were 
significantly correlated with each of the four performance measures. Those 
asterisked had also shown significant relationships at the state level, 
as presented earlier in Table 2. As can be seen, there were substantial 
similarities In the results of the two correlation analyses, especially 
for the job entry and welfare grant reduction measures. Relationships 



*The quantitative analysis was the main, but not the only, basis 
for selecting states. Regionality and structural variety were also con- 
sidered. See Mitchell, et al . (1977b). 

**Performance , demographic and economic information was obtained 
for all 214 local WIN units in the the ten study states. Within each 
state, data were collected for each variable for a comparable time period 
(CY 1977 or FY 1978 for most variables). The variables in our local level 
data base and technical details of the statistical analysis of that data 
appear in Appendix B. 
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Table 



r i-actors Sl pnlflcahtlv Rm1«^oH 

bach WIN I'erform.m.>P Measure at the Local L^^a/ 



Job EntTlea 

Peg Sponsor Staff 

Positive *Proportlon of VIN 
Factor* registrants vlth 12 

or more years of 

schooling 



Walfare Graat 
Reductions 

^Proportion of 
VTIN registrants 
that are male 



Retention 
Rate 



Job Entry 

♦Proportion of 
non**agricultural 
employees in low 
wage industries 



♦Prevailing wage 

♦Proportion of WIN 
registrants that are 
tnale 

Employer size 



♦Proportion of 
vnw registrants 
vith 12 or more 
years of schooling 

Number of sponsor 
staff per 100 
registrants 

♦Prevailing wage 

Number of SAD 
staff per 100 
registrants 



Negative *Proportion of popula- ♦Proportion of 
Factors tion below poverty WIN registrants 

that are non- 
white 

Proportion of 
population below 
poverty 

♦Proportion of 
non-agricultural 
employment in 
lowvage industries 

Proportion of regis- 
trants aged A5 or 
over 



Proportion of 
population below 
poverty 



Number of sponsor 
staff per 100 
registrants 



Average employer 
size 



Number of sponsor 
staff per 100 regis- 
trants 

♦Proportion of WIN 
registrants that are 
non-white 



♦Proportion of WIN 
registrants that 
are non-white 



-Proportion of WIN 
reglfitrants aged 45 
or over 

Proportion of non-ngri- 
cultural cr.pl ovTuent in 
lou^age Industries 



*rhFr,e relatlcnshlps were also found to be statistically significant at the state level. 
Fur ccrj.atlson to state resultc. eee Table 2. 

l^^^^ correlation analysis of data for 214 local WIN sites. All relationships are 
statistically significant at the .01 level or better. 
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•stmtlar to those observed on the state level also appeared important at 
the local level. 

Next, multiple regression analysis was conducted to examine the' 
combined effect of socio-economic factors on local WIN performance.* Table 
2.5 presents the factors that regression analysis showed as most signifi- 
cantly related to variations in each of the performance measures at the local 
level. For example, 30^4 percent of the local variation in number of Job * 
entries (the adjusted R ) can be "explained" by the combined impact of the 
five socio-economic variables shown in the table (employer size, density, 
labor force pacticipation rate, proportion of male registrants and poverty 
population) . 

The results summarized in Table 5 revealed several things. 
First, 52.1% of the local variation in , average WIN job entry wage levels 
was attributable to environmental factors. Of the four performance measures, 
then, wage level was most affected by local conditions. Most local WIN 
staff would not be surprised by this finding, since many expressed an 
understanding of the limited improvements they could make in entry wages. 

Second, although the envlroxunental factors explained between 30 
percent and 52 percent of the local variation in three performance measures, 
they accounted for only 14% of the differences in retention rate. The 
serious data and definitional problems associated with this measure are 
treated in more detail in Appendix B. 

Third, there is considerable overlap in the explanatory variables 
from measure to measure. With few exceptions, each labor market or demo- 
graphic factor which proved to be a significant influence on one performance 
measure also was a significant explainer of others* This over^lap suggested 
additional relationships existed among the environmental variables and among 
the performance measures. These relationships are discussed in Section 4 
of this chapter and In Appendix B. 

Identif ication of high and low performing local programs in ten states . 
The regression equations in Table 5 were used to develop standardized 
composite performance scores for the local WIN programs. The procedure 
was similar to that used earlier in the development of state performance 
scores. Again, the scores were based on the ratio of actual level of 
performance to estimated performance level. The local units' estimated 

*Slgnlf leant explainers were those variables that had regression 
coefficients with F-ratlo values greater than the critical values for a 
two-tall five percent F-dlstribut Ion test for significance. • See Appendix 
B for a technical discussion of the procedures ^jrtd tests performed. 
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Table 5 

Soclo-Economic Facto rs that Slfinif icantlv Exp lain 

Variation In Local WIN Performance" "^ 

(Results of regression analysis of local level data) 



-"/-^^-K^j Factors Affecting Local u riN Rttent^inn R^r> 



£xplanatory Varlahii>«i 

Population density 
Prevailing hourly wage 
I'nemp loymcnt rate 
[Adjusted R^».14i, N«l7l] 



Cuaulative 

.094 
.lU 
.136 



B«ta coef. 
(and direction 
of asaociatlon;^ 

-.32325 
.23740 • 
.17059 



F- ratio 
(significance^ 



18.681* 
10.089* 
5.694*** 





3. Factors Affac 


ting Local WIN Joh Fnr,.v D..^ 




(average entry wage/ local prevailing wage) 




Explanatorv Variablpa 


Cumulative 


Beta coef. 
(and direction 
of association^ 

.49341 
-.31557 
.22708 
.19432 
.13848 


F-ratio 


Loww^age industries 
Average employer size 
Poverty Population 
Male registrants 
Local employment growth 
[.Adjusted R-^«.521, N»173 


.177 
.285 
.450 
.452 


(significance;^ 

65.521 
21,835* 
11.660* 
9.486* 
6.582* 


Z. Factors Affactin^^ » 


ocal WIN Job Entries 


per Soonsor Staff 




Explanatory Variables 


Cumulative 

r2 


Beta coef. 
(and direction 
of association^ 

-.33735 
-.35063 

.27500 

.19646 
-.15874 


F-ratio 


Population density 
Poverty population 
Average employer size 
Male registrants 
Labor force partic. rate 
Adjusted R-^-.J04, N-I65] 


.064 
.133 
.211 
.287 
.325 


(significance;) 

20.881* 
16.306* 
9.506* 
7.131** 
4.530**** 


D. Factors Affectina Local Standardized Average 




Monthly Welfare Gr;ln^ Paw...^<^^f, 




Hxplanatorv Variables 


Cumulative 

r2 


Beta coef. 
(and direction F-ratio 

of aSSOCiaClrtn) ( aio^l f< ^^^^^\ 


Poverty population 
Lowwage Industries 
Population density 
; Ad justed R*^-. 4^9, N«ilJ4| 


.189 
.423 

.442 


-.48300 
-.32614 
-.28604 


44.006* 
22.004* 
17.065* 
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performance levels were based on what levels they could expected to 
achieve given their economic and demographic environment** 



High performing local units were Identified as those which scored 
in the top 25 percent of the range of scores for all 214 offices^ while 
low performers were In the bottom 25 percent* The 43 local programs visited 
In our study were classified as '"high", "low" or "average" according to these 
rankings, and these classifications were used In the qualitative analysis 
reported In Part IV of this report* 

4# Models of Soclo^Economlc Influences on WIN Performance 



The system of relationships among environmental and WIN performance 
variables that was identified by multiple regression was susceptible to 
path analysis which allows construction and testing of statistical models 
to examine relationships among variables* Various models were developed to 
. see which was the most powerful explainer of the Interrelationships Iden*- 
tlfled* This path analysis, which Is explained In detail in Appervdlx B, 
was premised on the hypothesized causal relationships depicted in Figure 
4. That figure shows that environment could affect' performance* It also 
assumes that retention rate. Job entry wage rate and the number of Job 
entries might have an effect on welfare savings^ but that (1) welfare 
savings could not affect the other three measures; and (2) none of the four 
performance measures could influence environmental conditions* This was 
the model that the path analysis tested* 



Soc lo-'Cconov Ic 


► 


Job Entry 
W«$« 1UC« 










► 




rob Eatrlt* 
par SK^tt 




Figure 4 

Hypothesized Model of Causal Relationships 
Among Environmental and Performance Variables 



*We used two sets of local composite scores, one including reten- 
tion rate and the other excluding it* This was done since the reliability 
of the retention rate data at the local level was questionable* However, 
the general rankings of the local programs were very similar for the two 
sets of scores* This may have been because units that perform well on 
retention rate probably have high performance levels on other indicators 
also. That Is, the program emphasis is on the balanced mission to provide 
quality jobs to as many registrants as possible* The scoring procedure is 
discussed In more detail in Appendix B. 
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That analysis confirmed and further clarified what the earlier 
regression analyses had: (1) that socio-economic environmental 
factors have a significant Influence on WIN Job entry wage rates and iob 
TffllV rJ'"* performance variables In tuJn hive a large 

d! ?nLr savings;* and (3) that the retention rate measure (as currency 

defined) contributes little to explaining variations In local performance" ^ 

Our findings on the Impact of socio-economic variables were important 

!nd°'^''l''j* K^'^"" ^^'"^^^^ themselves. Data on the economic 

and cllent-demographlc factors affecting performance can be useful In evalu- 
ation or organuatlonal analysis of state or local WIN units because they 

r!reff!nT th"';'? ^ ""f^ minimizing distortion due to environmen- 

tal effects. The Information. may also assist planning arid locatlonal deci- 
sions, since It suggests ways to predict more precisely' what potential per- 
formance can be expected from WIN operations In different kinds of commu- 
nltles or labor markets. 

O.ur findings also have Important Implications for resource allo- 
1 ?K "^hf /^'^^^"al. regional and state level. They suggest 

the possibility that allocation formulas might be developed that provide 
performance Incentives while taking into account the relative difficulty 
S N orn! ^"'^ demographic conditions facing different state or local 



*ln fact, performance levels on job entry wage and job entries 
?educUoL!°^^^ ^''^^^^^ °^ variation In local welfare grant 
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CHAPTER 3 

EXTERNAL POLITICAL AND BUREAUCRATIC INFLUENCES 



Chapter 2 identified the influence social and economic environ- 
ment has upon WIN programs. Now we turn to a different set of external 
Influences, the political and bureaucratic settings In which state WIN 
programs function. These Influences are essentially external to the 
employment security and welfare agencies of which WIN Is a part. They 
include politicians such as governors and legislators; support systems 
such as civil service commissions and administrative services departments; 
other state agencies and programs; and lobbies or special Interest groups. 
Federal influences transmitted by regional offices are also examined. 
While regional WIN unlfs are obviously internal to the overall WIN system, 
from the perspective of the states they are an external Influence. Thus, 
they are treated here as. part of the political and bureaucratic c vlronment 
of state WIN programs. 

Th6 chapter begins by examining the interactions between state 
WIN programs and federal regional offices. Then the effect of state 
political influences, including politicians, legislatures, and lobbies, 
are discussed. The Impact of state personnel and administrative service 
systems are considered next, followed by linkages to other state level 
agencies or programs. i 

I . Regional Offices 

This section considers the relationship between state WIN programs, 
and federal regional offices of HEW and DOL, especially the regional WIN 
units. These units, which are composed of both DOL and HEW personnel, 
are usually housed in the Employment and Training Administration of DOL 
regional offices. The main concern here is not the character, structure 
and management of these urtlts or their links to the WIN national office 
in Washington. Those Issues will be covered in a separate study of the 
federal parts of the WIN system. Our focus is only on state-regional 
contacts and activities. What do regional offices do with, for or to 
state W.IN programs?' Are there differences in what they do, and if so, 
with what effect on the states? Ultimately, do regional WIN units make 
a difference to the performance of state WIN programs? 

» 

The data on which this section Is based aie bounded in scope and 
Clme. Interviews were conducted about six regional offices at the state 
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level but were conducted In only five of those offices. In one of those, 
five, only a limited number of Interviews were possible due to the Ill- 
ness or unavailability of several potential respondents. Furthermore, 
several of these units were obviously in transition at the time of our 
visit. Nevertheless, the data and the patterns described below are valid 
for that moment In time. They reflect the character of those units and 
their links to our ten sample states for the same time period in which 
data on state and local WIN operations and performance were collected. 

The section addresses, in turn, regional office (1) allocation 
procedures and funding decisions, (2) goal-setting and planning functions, 
(3) site reviews, (4) provision of technical assistance, (5) communica- 
tions with states, and (6) program advocacy efforts. 

-•^ 

Allocations and Funding; 

Regional offices differed in their approaches to allocating funds 
to the states. Only one of the five for which we had data reportedly 
based discretionary allocations exclusively on the national allocation 
formula. A second had devised its own procedures that rewarded high 
performers and punished low performers more than the national formula. 
Athlrd office indicated it usually shaped discretionary allocations to 
the number of WIN registrants in a state rather than comparative perform- 
ance. In two regional offices no one but the individual responsible for 
computing the allocations (in one case the regional WIN coordinator) was 
sure what the bases of allocations were. 

Regardless of regional formulae or emphases, underspending was 
generally heavily punished. Both high and low performing states in five 
of the six regions complained that this blunted the meaning fulness of 
performance incentives and could cause serious operational disturbance 
in their programs. At the time of our fieldwork, for example, one high 
performing program was trying to figure out how to adjust to a 20 percent 
allocation cut due to underspending on OJT and PSE and a decline in number 
of reported registrants. Options included withdrawing the program from 
parts of the state, shifting the SAU more heavily to Title XX funding 
If possslble, and seeking the governor's intervention with the regional 
office. 

The amount of information regional offices shared with the states 
about their allocation procedure — and, thus, the ways states should optimize 
performance and rewards— reportedly varied considerably. On the one hand, 
three regional offices provided no details to state officials. This was 
beiciuse the federal representatives themselves did not know. In one region 
at least this was because the regional coordinator did not want the states 
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to have such Infonnatton. On the othor hand, one regional office provided 
copies of the national allocation formula manual to every state in the 
region and had actively engaged in a. dialogue with them about allocations. 
The states in this region were themselves in the process of Jointly 
developing an alternative to the existing allocation procedure. 

Finally, the uncertainty and instability of funding provided by 
the regional offices was reported co affect state program operations. 
With few exceptions, state officials reported that federal funding and, 
thus, state and local unit activity goals. often changed during the fiscal 
year. Local staff recalled frequent "stop-aKd-start" messages about spending 
especially for OJT and PSE contracts), and managers complained about an 
inability to plan and operate on a long-term basis. However, several high 
performers appeared to cope with this situation better than other states, 
for example, by juggling certain SAU expenditures from WIN to Title XX 
depending on the availability of WIN funds. 

Goals and Plans 

There was less variance in the way regional offices apportioned 
activity goals to states. Generally, targets followed dollars. If a 
state got 20 percent of the region's money, it also was assigned 20 percent 
. Of the region s planned activity goals. However, three of the regional 
WIN units hedged against uncertainty by increasing the overall regional 
targets or by assigning somewhat higher targets to state programs that were 
historically -nore productive. 

The procids by which these goals were set varied somewhat, as 
•did the role of the regions in the unified WIN sponsor-SAU budgeting and 
planning process (in its first year at the time of our f ieldwork) . In 
three regions the inputs of federal representatives and even the states 
themselves were taken into account. In two others, targets were simply 
allocated to the states by the regional coordinator. Similarly, two 
regional offices took an entirely "hands-off" attitude toward unified 
budgeting and planning. Two others advised states as to what the divi- 
sion of rosources would have been in prior years, but left the decisions 
to the state personnel themselves. Finally, two regions "suggested" to 
some of Its states the appropriate WIN and SAU portions. 

Site Reviews 

There was great variety in regional WIN units' approach to site 
reviewing. State and local respondents in one region reported that 
regional office federal representatives almost never involved themselves 



39 



in local unit site reviews. Even visits to the state office were limited 
to quarterly half-day sessions in one of these states. 

nnA contrast, federal representatives in another region were trained 

and encouraged to become intimate with the local operations in their states, 
In the sample state in this region, the federal representative averaged 
one sltv^ visit per month, and those visits involved three days of detailed 
review analysis and dialogue with local personnel. She also regularly > 
^nfcAH H?'^^""^'^^ managers meetings and met with the state WIN 

and SAU directors weekly. During site reviews, the federal representative 
struck a posture of joint problem-solving rather than Investigation. 
fn'mM^'' ' ^^'^ prepared a report with suggestions that was given 

o WIN management and local personnel. According to state respondents, 
her effectiveness was enhanced by the fact that she had been stationed 
or two.''^^'''' several years Instead of being rotated after a year 

Most rfegions fell somewhere between those extremes. Thus In 
one region one sample state was the subject of frequent federal repre- 
sentative site reviews while another was rarely visited, m a second 
case the regional office, which had actively site visited In the past, 
had just enunciated a policy of delegating that function Increasingly 
to the states. Program leaders In one of those states were concerned 
about the eventual effects of that policy. Their WIN program was adminis- 
tered through the ES chain of command down to the local office level, 
and they knew that federal Involvement In site reviews had been essential 
in getting certain local programs turned around". They feared that 
irv iri"'' f^f'^f P'^esence would adversely affect the attention and prior- 
ity WN received In the local ES offices as well as regional office under- 
standing of grass roots realities. 

Technical AssistanrP . 



State Interviews revealed substantial variation In the technical 
assistance regional WIN units were perceived to provide on service delivery 
t inane al management or reporting/computerization Issues. Thus, two regions 
were v ewed by sample states as unable to give them much meaning furassfs- 
tance la any of these categories. State respondents cited as reasons (1) 
the frequency with which federal representatives were rotated. (2) their 
lack of grass roots experience or specific technical expertise, and (3) 
the r personal limitations in dealing with people. At the time of our 
leldwork, these offices had also reportedly conducted little training 
tor state personnel. * 
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By contrast, a third region was viewed as providing important 
technical assistance. Federal representatives were generally perceived 
as no leas knowledgeable or competeiot than state personnel and, thus, a 
useful source of advice and Ideas. The regional office also made heavy 
use of temporary assignments of .federal personnel to state positions or 
state personnel from one state to another, thus, sharing existing exper- 
tise around the region. Finally, the regional unit reportedly operated 
an extensive program of seminars or. training' courses tailored to the 
expressed needs of the states. 

• 

The other three regional units fell somewhere between these 
extremes. Usually this meant that only one or two individuals in the 
unit were perceived by state personnel as having substantial program 
and technical knowledge or that unit personnel were competent to advise 
In one or two areas (e.g., budget preparation and financial management) 
but not others (e.g., ESARS or service delivery techniques). 

Communicit Ion 

Generally there was quite frequent (often daily) telephone contact 
Involving routine Information exchanges between regions and states. 
However, f;ace-to-f ace contact between the region and the state varied 
greatly among regions, as noted in the section on site reviews. Similarly, 
regional units' postures toward lateral contact among their states were 
noticeably different. Officials in two regions indicated they preferred 
that their states not have much communication with each other, in part 
out of concern that "they might gang-up" or gain information the regi'on 
did not want shared. Formal and informal contacts were actively discourr 
aged. Region-wide meetings were limited in number or dominated by federal 
officials, and there was no evidence of temporary staff exchanges among 
states. This posture contrasted sharply with that of two other regions 
that construed their role as facilitating inter-state contacts.* 



*[n one of these cases, lateral communication and collaboration 
went hand in hand with competition among the states over performance, 
encouraged by the regional WIN unit. This type of competition was con- 
sciously minimized in two other regions, in one case due to regional ETA 
leaders' preference for "region-wide teamwork". The WIN unit in that 
office was prevented from giving public recognition to the highest per- 
. forming program In the region on the grounds it would adversely affect 
the general attitude ETA was seeking to cultivate among SESA's in the 
reg Ion. 
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Patterns of federal-s'tate disagreement and conflict resolution 
were generally similar acroas al ' regions. Usually they • Involved tele- 
phone contacts between the state and the regional unit first, and then 
written statements from, the state to the region. Officials in at least 
three states felt the best tactic was to put their position in writing 
and force the region to do so, too. In their experience, this sometimes 
led the region to drop the issue or at least compromise.- One or two state 
program directors said that they also found it effective to sometimes 
assert that they were going to do things their own way. There was only one 
state In the sample which reportedly circumvented the region to take its 
case directly to the national office. 

Pr.oE. ram Advocacy 

Apart from money and information, the major service regional WIN 
units might provide state programs was as an advocate for the program 
within the state, within the regional office or within the national office. 
While we have some evidence that several regional coordinators were partic- 
ularly forceful in representing the interests of their states on financial 
or policy Issues at national meetings, the effect of this was not clear 
from our data. - v 

Data on the frequency and effect of advocacy efforts within the 
regional offices and the states were much clearer. There was evidence 
of vigorous and effective program advocacy efforts by the WIN regional 
unit within one regional office. The unit head had gained the respect 
of the KTA regional administrator and achieved a degree of acceptance 
and support from him that was unusual. Although an HEW employee, the 
WIN coordinator regularly attended the ETA administrator's executive staff 
meetings and played an instrumental role in the regional employment and 
training institute. The institute had developed a number of courses useful 
to state WIN personnel. Like most regional admlnistratbrs. this one dele- 
gated WIN responsibilities broadly to the WIN coordinator, but he also 
had made it clear his active support was available as necessary. Further- 
more, he reportedly had let other ETA staff know of his concern for the 
program and his desire that they stay "aware" of it. As a result, the 
status of the program within the regional office was unique within our 
sample. 

r.ere was no evidence of any regional office interventions on 
behalf of WIN with governors or state legislative leaders in any of the 
ten sample states. Furthermore, there was little evidence that regional 
offices HAd actively intervened on behalf of WIN with SESA or welfare 
department top leadership during the past 3 or 4 years. According to 
both regional and state respondents, most of the efforts that did occur 
(1.0., attempts to get line authority for the WIN central office, to 
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affect spending or staffing const^lnts that were causing SAU underspend- 
ing, -or to ease out-of-state travel restrictions) were Ineffectual. The 
one notable exception was a state where a vigorous Intervention by the 
ETA regional admnlstrator and the federal representative caused the SESA 
chairman and the F.S director to alter the agency's attitude and behavior 
toward WIN (see Chapter 6, Section 6). 

Effect on State Program Performance 

The data presented in this section Indicate that WIN regional 
units were very diverse In the way they approached the same tasks and 
In their Interactions with states In their regions. The dAta also sug- 
gest that regional office Impacts on state WIN programs were in general 
quite limited. Regional allocation decisions and funding procedures 
clearly had operational effects on state programs. Regional WIN units 
did serve as conduits for routine Information from Washington to the 
states and visa versa. But beyond that, the observable effects were 
few. Regional monitoring was exerting genuine Impacts on local opera- 
tions In only two of the ten sample states. Only one state In our sample 
credited Its regional WIN unit with being able to provide directly most 
forms of needed technical assistance. 

The Interview responses of state level WIN personnel reflected 
this situation. Staff in two of our high performing states told us that 
their regional office had played a significant part in their program's 
success. These were the state in which the regional ofNfice had played 
a strong program advocacy role and the state where the federal represent- 
ative was extensively involved in site reviews and in constant consulta- 
tion with state and area program administrators. Respondents in all 
eight o^f the other states gave their regional office little or no credit 
for their program's success— or its failure.* 

The- issue of the role and capabilities of WIN regional units is 
addressed further In our separate study of the WIN federal management 
"system. 



*In tact, respondents In two states (one low and one high performer) 
In a region of generally high performers repeatedly told us that their 
regional office provided none of its states with much meaningful assis- 
tance. They said It was important that the high performance, prevalent 
In the region be attributed to the exceptional competence of managers 
and staff In sev.eral of the states., combined with a tradition of exten- 
sive Inter-state exchange of ideas and information. 
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2. State Political System 

This section focuses on the interactions between WIN and state 
level politicians, principally governors, legislators and their appointees 
or staff. The. visibility of the program is examined in terms of politi- 
cians awareness of WIN and state level lobbies' interest In the program. 
Next, state level oversight of WIN's budget is discussed. Then, politi- 
cal interventions in the treatment of individual clients, in WIN personnel 
matters and in WIN site location decisions are considered. 

Program Vtsibillty 

Awareness of and interest in WIN was generally low. In six states 
inte:vlew data indicated state level politicians were almost totally unaware 
or unlnterested^^in the program, and WIN was described as "invisible at 
the state level". Contacts between the state WIN sponsor or SAU directors 
and legislators were rare. Although governors and other politicians 
frequently made public , statements about "welfare reform", "workfare", or 
reducing welfare expenditures, no respondents remembered them ever publicly 
Eeferring to WIN.* *^ . 

In four states the situation was somewhat different. One was a 
state in which the top WIN priority was getting unemployed fathers off 
welfare under the unemployed parent component of AFDC (AFDC-U) . Local 
unit performance was measured first in terms of the number of AFDC-U cases 
that had been., closed. This emphasis came from the highest levels of state 
government. For several years, the governor had placed heavy emphasis 
on putting men on welfare to work. In fact, he had used the success of 
the state's WIN program in reducing the AFDC-U caseload in his campaign 
.for re-election. 

In a second state occasional legislative discussion of WIN was 
reported. In addition, one U.S. Congressman had paid several visits to 
the WIN unit in his district and intervened on its behalf to improve 
linkages to the local CETA prime sponsor. In two other states the 



*I.n two states legislative concern about the "welfare problem" 
led to the passage of state laws requiring registration for work as a 
condition for receiving welfare payments. SESA leaders helped assure 
that eligibility criteria written into these laws were identical to those 
In WIN and that welfare applicants required to register for work under 
state law could fulfill that requirement by registering for WIN. Thus, 
these two laws had no noticeable effect on WIN. 
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program leadership took the Initiative In cultivating links to elected 
officials by providing them with periodic reports or laudatory regional 
office reviews. As a result favorable references to WIN by politicians 
occasionally appeared In the media. 

Political Impacts on state WIN program policy or content were also 
extremely limited, the principal exception was the state where WIN's 
objective of zerolng-out AFDC-U caseloads was politically inspired. Respon- 
dents in several other states where welfare was county-administered indi- 
cated that county officials occasionally might use their legislators to 
deter the state from compelling county compliance with WIN regulations. 
Kven the policy influence of the political appointees who served as SESA 
commissioners was generally limited, usually involving only the rati- 
fication of recommendations by career employees. 

Similarly, state level lobbying groups almost wholly ignored WIN. 
Respondents indicated It attracted no attention from feminist, business, 
or public interest lobbies In any of the states in our sample. While 
welfare rights organizations were mentioned in five states, there were no 
reports of lobbying or protest activities directed at WIN in recent years. 
Thus, at the time of our^ f ieldwork lobbies exerted no significant impact 
on state WIN programs. 

Budget Review and Funding 

State level budget review and appropriation processes also raised 
little interest In WIN. In nearly all states WIN sponsors found it possible 
to match the federal grants with in-kind contributions from OJT and PSE 
contracts. Thus, the WIN sponsor (like the ES) involved no appropriation 
of state funds, and its federal funds were either ignored or passed through 
automatically by budget bureaus, legislative staff and legislatures. 

In most sample states the SAU budget also usually encountered 
l.lttle difficulty at the state level, even though a cash match was required 
for their federal funds. This was partly due to the fact that SAU's often 
S underspent their budgets and partly because the 90-10 match was viewed as 

a "good deal" by legislators used to federal programs requiring bigger state 
matches. Despite this general pattern, there were several states in the 
sample where the budget process Impacted substantially on WIN funding. 
Four states reported cuts In the state portion of SAU funds because of 
underspending In prior years or state-imposed limitations on the number of 
authorized positions. Two Indicated that the budget process resulted in 
Title XX social services funds being earmarked for WIN. 
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Even In these states, however, the process was a cursory one. 
Thus, In the state where budget review was most detailed (and where 8- 
10% cuts in the SAU budget generally resulted), budget analysts reported 
spending maybe two hours'*" on WIN. Only two state SAU* or WIN directors 
reported ever having to appear before legislative committees. Usually 
the WIN budget was presented by an official of the budget bureau, welfare 
department or SESA as part of the overall department budget. No program 
audits or evaluations by executive or legislative staff were reported in 
any sample state.* 

P olitical Interventions 

Interview data revealed the occurrence of three types of political 
Interventions in state WIN programs. In five states it was reportedly 
not uncommon for politicians to request special treatment for particular 
clients. Thus, sanctions could not be instituted against a certain regis- 
trant or a particular WIN client had to be provided a specific type 
of training. Some manipulation of hiring and promotion procedures for 
personal or party patronage also was reported- in five states. Finally, 
In seven states there was political interference in decisions about site 
locations, office space or purchased services. 

Tahlo 6 summarizes the data on reported political interventions. 
The ten sample . states are indicated by the letters A through J and arrayed 
by performance, with the high performers at the left .** Analyses revealed 
no statistical relationship between state program performance and political 
Intrusions. However, all three types of reported intrusions tended to vary 
together by state; those states reporting more of one type also tended to 
report more of the others. Other data indicated that where such interven- 
tions occurred, they were not unique to WIN but were present throughout the 
SESA and elsewhere in state government. 



*Several. respondents in one state reported that the governor's 
manpower office had precipitated a "review" of WIN several years earlier. 
However, apparently no report of findings was ever circulated. 

** This convention will be followed in similar tables throughout 
the report, state E is the program that suffered declining performance in 
the year our interviews were conducted. 
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State WIN Programa 
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3. Support Systems 

This section considers the support systems, such as state personnel 
systems and administrative service agencies, on which state WIN programs 
depend to varying degrees. The autonomy of a program — the capacity of 
Its ovm managers and staff to decide its fate — hinges in part on the 
responsiveness and flexibility of such systems. They may affect the be- 
havior of organization leaders, the conduct of management functions and 
the characteristics of program staff. Thus, they could influence program 
performance indirectly. 

Personnel Systems 

The formal and informal characteristics of state personnel systems 
varied substantially across our sample, and these variations created dif- 
ferent operational realities for WIN from state-to-state. However, our 
analysts revealed no clear association between the characteristics of these 
systems and WIN program performance. 

Hiring. Some type of full or partial hiring freeze was in effect in five 
of our ten sample statos. In two the reasons seemed purely fiscal; state 
revenues were tight, and although WIN was essentially federally-funded, 
It did not escape the general proscriptions It was time-honored practice 
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In two other states for an ^in-coming administration to formally freeze 
hiring so that more centralized control could be maintained for patronaise 
purposes. Finally, in one 'state both the SESA and welfare department 
were under court order not to hire until discriminatory practices were 
ended. Ih only two of the five states did interview data indicate that 
the effects of those freezes were severe enough to affect some local WIN 
Office operations. In most cases, there were ways around them (i.e., 
exceptions, hourly employees, provisional hires) or the interdictions 
were not severe or long-lasting enough to substantially affect normal 
staffing levels. 

In all ten states all regular hires by the WIN sponsor involved 
the formalities of examinations^ registers and interviews. Similarly, 
all SAU hires (whether for state or county positions) were based on state 
civil se.vice system tests and lists. Applicants were then Interviewed 
by county welfare. of ficials in the states where welfare was county- ' 
administered. ' 

Despite the formalities, in four states where patronage intrusions 
were substantial, "provisional" hires were often made in the SESA. In 
some cases provisionals" became permanent without ever passing a test. 
Similarly, in three of these states WIN managers said it was easy to 
dispense with one i;egister and get a new one in an effort to "reach" a 
particular individual. 

Variation existed in affirmative action efforts, too. Para- 
professlcwal positions were used In four WIN programs to recruit disadvan- 

7^"°'^^'^y ^t^"- a fifth, affirmative action efforts in the 
SESA had led to the creation of separate registers for women and minori- 
ties. Elsewhere affirmative action hiring efforts were less obvious, and 
in nearly all states female respondents saw the fact that veterans received 
preference, (o-ften extra points on their test scores) as a disadvantage. 

None of these variations In state hiring practices were shown to 
be related to differences In WIN program performance. 

Promotions . Promotion procedures also differed across our sararle. In 
three states, promotions in the WIN sponsor required written or profi- 

''^''"v^^r^^' ^" "^^^^^ openings were posted and applicants 

who bid for them were interviewed by the office manager and by the ES or 
WIN area administrator. Final decisions might require are^, central 
office or even cabinet-level approval, depending on the level of the 
.position in question and the state. As noted earlier, patronage concerns 
played some part in personnel actions In five states. 
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Promotional opportunities for local WIN staff also varied. In 
several states there were only one or two classifications of service 
delivery jobs In the WIN sponsor before an individual had to move to a 
supervisory Job or out of the program. This condition was even more 
prevalent for SAU's, which often had only a single social worker classi- 
fication for SAU staff. As described In Chapter 6, several high perform- 
ing WIN programs were either able to create an internal career ladder or 
had status enough within the sponsor agency so that WIN personnel found 
it easy to move Into managerial positions in other parts of the SESA. 

Speed. The speed with which civil service systems permitted WIN managers 
to fill vacancies also varied substantially but was not associated with 
performance levels. At one extreme were three states which reported that 
the normal time from requesting the register to filling the Job was be- 
tween three weeks and two months. At the other extreme were five states 
that reported it took between six months and a year to fill a job. Among 
the reasons cited for these delays were (1) lengthy posting requirements, 
(2) strict adherence to detailed procedures due to affirmative action 
concerns or collective bargaining agreements, and (3) fiscal or political 
reviews of all hires or promotions. 

Reclassifications . In five states problems Involving reclassifications 
were described by WIN or SAU officials. In three of these, general re- 
classifications had led to downgrading of some WIN positions (and In one 
case SAU positions as well).. The SESA in a fourth case had been exten- 
sively reorganized, resulting in anomalies in grades and Job descriptions. 
In all five these occurrences disturbed the morale of some Individuals 
and diverted some staff time to grievance or appeals proceedings. Some 
concern was expressed that in the long-run the downgradlngs would compli- 
cate staff retention and recruitment. But, In general, these disturbances 
were seen as an unavoidable If unpleasant part of employment In state 
government. ' . 

Unions . In seven of our ten sample states, collective bargaining agree- 
ments covering public employees such as WIN staff did not exist. Some 
type of employee's association was present in five of the seven, but 
even the most vigorous of these only lobbied the governor and legislature 
for salary or fringe benefit increases and represented individual workers 
in grievance procedure?. Their impact on WIN was minimal. 

Rertpond^-nts in the three WIN programs that were covered by union 
contracts indicated that those agreements had significantly affected pat- 
terns of promotion and lateral transfer. In each case seniority alone 
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governed advancement and rights to accept or refuse transfers. Merit- 
based criteria had been abandoned, and managerial choice was diminished. 
.While staff in one of these states attributed recent salary increases to 
the union s presence, respondents in all three said that the union had 
not had the anticipated effect of reducing political intervention in 
personnel matters. 

Administrative Services Agencies " ^ - . 

Interactions with administrative' services agencies. usually in- 
volved procurements of office apace, supplies and equipment. In seven 
states in our sample these functions did not, in fact, involve ai\ exter- 
nal agency at all but were performed by a bureau of the SESA or welfare 
department. In two of the other three, respondents indicated that the 
services department sometimes vetoed their requests to lease a particXilar 
office on the grounds that the rents were excessive. One of these depart- 
ments also reportedly exercised judgment as to the political appropriate- ^ 
ness of particular locations. Overall, their impact on the program was 
not seen as substantial. 

' In general WIN personnel were' rarely, much involved in office --.pace 
decisions. In one state and part of another, the state WIN director played 
a role; In a third state and occasionally in a fourth, local WIN managers' 
had some part in the choice. Elsewhere, WIN sponsor sites were often 
pre-determined by ES office locations. Similarly, SAU locations were • 
generally based on where other welfare staff or the WIN sponsor, in the 
case of collocated units, were housed. In five of our sample states, office 
space decisions were reported to be very political. Those five states 
Included three where the SESA did its own procurement and two where a 
separate administrative services agency was involved.* 

■' • / 

Finally, SAU officials in two states reported that the adminis- 
trative services agency or another state-wide control mechanism had effec- 
tively barred them from ouf.-of-state travel and, thus, from attending f 
regional office meetings or training sessions. 



*1here was only one state in our sample where constituent service 
concerns reportedly motivated elected officials to seek the location of 
WIN units In their districts. In that case blatfk and Spanish-speaking 
state legislators reportedly successfully lobbied the SESA for WIN units 
to be located In certain parts of one urban and one rural area. 
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^* other State-Level Agencies. Programs and Organizations 

WIN program interactions with other state agencies or programs 
and with interest group organizations operating at the state level were 
generally few and unimportant.* 

CETA 

Relationships between WIN and CETA at the state level fell into 
three categories.^ First, there were four states in which WIN contacts 
with the governor's manpower staff and the state employment and training 
councils were extremely limited and, in several instances, tinged with 
hostility. • WIN central office staff indicated it was often months between 
personal com - mication. WIN access to resources available from these 
entitles either at the state level or at the local level in the balance-of- 
state area were generally minimal. 

In a second group were five states where there was more contact, 
^formally at least, at the state level. These included the two programs 
with members on state councils and another in which WIN and the CETA 
balance-of-state staff reported to the same individual. WIN access to 
resources and WIN-CETA relations were, however, variable from site-to-site 
within the balance-of-state area. The patterns of access and interaction 
were largely shaped by the relationships of local WIN staff and local 
manpower of f ic lals— not by relationships at the state level. 

Third, there was one state where the governor's manpower office had 
contracted with the SESA to conduct most CETA functions in the balance-of- 
state, and the SESA, in turn, had chosen to carry out these functions through 
integrated CETA-WIN units. Increased WIN access to CETA PSE was accompanied 
by extensive diversion of WIN staff to CETA activities, as Chapter 5 will 
describe.** 



*For a discussion of the interaction between local units of these 
programs and WIN service delivery units, see Chapter 13. 

**Slnce our field research was completed prior to enactment of the 
CKTA Amendments of 1978, we cannot assess their impa:t on CETA-WIN links. 
Title II of that legislation limits eligibility for mcsc CETA training and 
PSJ- lobs to the "economically disadvantaged" including welfare recipients. 
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Vocational Rehabilitation and Education 



In eight out ot the ten sample^states there was, in fact, no 
"""r^K^ work-related linkage at all between vocational rehabilitation (VR) 
and the WIN sponsor or SAU at the state level. One of the two remaining 
states was the cite of special VR-welfare teams for disabled AFDC recipients 
Hie other was a state where a VR employee who acted as liaison to the 
welfare agency was housed In the same bureau as the SAU. This was also one 
of the few states where VR-WIN links at the local level were closer and 
more productive. Without exception, no WIN central offices reported any 
current relationship with state educational or Vocational education agencies 
Several indicated that the ralson d^etre for such links had passed with WIN 
I and its emphasis on training. Few connections with any other state 
governmental entities were mentioned.* 

This chapter has described the political and bureaucratic envi- 
ronment that surrounds WIN and Its host agencies at the state level. 
Unlike socio-economic variables, the impact on WIN of these kinds of 
environmental Influences was shown to be limited. Our analysis revealed no 
association between these factors and performance. We found that both high 
and low performing WIN programs sometimes faced similar problems from 
.uneven flow of federal funds, political intrusions and support systems. 
It Is possible that some of the same internal characteristics that make 
high performers more productive also make them more adept at by-passing or 
alleviating these problems. It is to these internal characteristics that 
we now turn our attention. 



*The linVs between the SAU and welfare-run placement programs, pri- 
marily for state general assistance recipients, will be presented in 
Chapter 5. " . 
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PART III 
STATE WIN PROGRAMS 



: *:v;\)x^niyij state WLV pvojvama tended to be managed differenttyj^ 
tha>i Itr: i^'vy.^r^u:v3. rhdh* leaders irivarted to local WIN sponsor staff a ^ 
.Uyurcr i-ev.^^^: : !.oy: sf national projrarn joals, including the balanced importance 
•V' ^I'^'d the quantitj of Job entries. SAU personnel defined 

the it* riu\r^^>: Kcn' c>ilj as providinj social sewices to registrants but also 
w..; ! iK<.ij^:j iyicome naCnteKanae units and Title XX. Goal displace-- 

meyii md i\\)\Km^e diversion by host agencies was infrequent or minimal. 

;7:\;^ : ^'rf..'):^.e^yije in state WIN programs was also associated with: 

0 /•A;>v; frequent and extensive training of staff, 
jf:e>: conducted Jointly for sponsor and SAU 

0 r!<.lat:ivcly accurate, trouble-free reporting 
j.^stems due to the acquisition of technically- 
<T,iiKed staff, ci^eation of problem-solving 
I 2'ocedia*ns arid development of WIN-IMU 
liKki,:jes for reporting on obtained employment 
ind '^'elfar'e grant reductions. 

0 M:r^: intensioe and sophist icated monitoring, 
fi'^n iyicluding comprehensive and structured 
Jji^i% visits to both SAU and sponsor units. 

0 Ar>\i e^taff or field technicians with extensive 
ir jri/n rxpctn^ence who provided technical 
u\rl stance arid a visible program presence in 

fi*dAl while also serving as a communication 
^ .vni)yig local units and between local staff 

r,tatc vrogvcvn leaders. 

0 V->'. • .;;v."^' upuhx)'d crm'iunications from local 
:<>.:''.: fn thr ce>iiral office. 

0 ;>'"v i^f l itrril coiwruyiii 'avion K.vnong local - 

*'* rf throu^ih r^t^ii^^'j.Ul' meeti>;^fs, trainiwi 
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•j'A'^v ■-.'Hulyr^uii^c inniuii ilvj.h.! and budjaUn^j 

,•; -*:'■■ . "^''^^^ >u^it.ru'i' the ^z^e or .nate W.V 

^ 'ythln hcuiL i'ESA-und Dclfavc cinmjic^i, 

^'■''"■[\ f^^^-* t/i-V^ opovatod wcpa i'f'latcd to their 

' ('^;-i:'j'/!'('j:i}ti'ant jmUo) vaHed 

. "V.M*/;';. ■ '■' -ci.! .'•iin'f'U,\iniij ^'OPiKdatcd with the 

' •" •■ 't.\'v;^ <.■''!; lojrk'nt. 

^, ': . \- ' V •''!<■•' -.Vic/ iV/,V iiron^^oi- c'oo}\ii>u.itor>3 uud not 

in., .'K.ir i.':.,,t' tJu::/' imcvaotums appeared related 
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, ^i>ri:.f.j rrojivv^j uere jound both wher^ Win 
.. _ . '-'•■^.•••^i-'' - y.t-^' ihe. hierurehj and vJicre WliJ uas "self- 

'-w ■ Jripte sUiteiS indiaated tliat self-contained 

: ■ ' y^y^-- '/^ oy ho<Jt ajene;/ hoGtiliPj but tiiat 

y v; \-''' nierareh:< required the support or at least 

•• ''-V''^"' t.tuied to'reeeive at. least moderate swn^ort 
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INTRODUCTION TO PART III 



The prect^ding chapters have examined the impact of various types 
of environmental influences on state WIN programs • Now we turn our atten- 
tion to these programs themselves, focusing throughout Part III on the 
set of Items labeled "major determinants" in Ficfure 5, These are the 

elements which our research on WIN and other employment and training programs 
suggests may shape the structure and processes of the local delivery system 
and thus Influence overall productivity* 

For simplicity the diagram presents each of the major determi** 
nants as a separate, monolithic entity. In reality, the situation is 
more complex. Each of these major elements is itself composed of a cluster 
of items or constructs. For example, "overall structure'^ encompasses a 
number of subcomponents. These include the organizational configuration 
of SESA and welfare agencies (the "host agencies"); the location of WIN 
and SAU in these host agencies; the program's size; and the linkages between 
the WIN sponsor and SAU and between WIN central offices and their local 
service units. 

In addition there may be interactions between major determinants. 
For example, the goals of the program are largely determined by national 
policy on WIN objectives. However, host agency and WIN program management 
may also influence WIN goals within each state. These goals may, in turn, 
affect the priority given to different tasks and the program's administra- 
tive structure. WIN leadership may also have some influence over program 
staffing, depending on the authority given them within their host agencies. 
Together, these factors may Influence work unit characteristics and, thus, 
indirectly affect program performance. 

The first chapter of Part III deals with how program goals are in- 
terpreted and the impact of differing goal interpretations on the priority 
and' structur Ing of program tasks. Following chapters deal sequentially 
with state program structure and with leadership, management and staff 
charact-er ist Ics . A concluding chapter focuses on the characteristics 
'^insistently present in the high performing state WIN programs. 
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M ajor Der-emilnants the Organi;satioa 



CHAPTER ^ 
STATE PROGRAM GOALS 



This chapter deals with how the goals of the WIN program are 
Interpreted In the state organizations responsible for the program. The 
focus is less on what national policy documents or allocation formulae 
say and more on the goals and purposes of state WIN staff and host organi- 
zations in operating the program. 

There may be important differences between national and state 
interpretations of WIN goals. State or local WIN personnel may be unaware 
of national priorities. Even if they are aware, they may fail to apply 
them in training staff, allocating resources, structuring reporting systems 
and assessing performance. Beyond that, the employment security and 
welfare agencies in which the programs are housed may have their own 
priorities which compete with those of the national program. 

The goals of the or^janiza t ion that runs the WIN program are 
Important because they may influence program organization and tasks. 
In the WIN program variation in structure and tasks is presumably limited 
by the ^WIN Handbook which prescribes relatively uniform procedures and 
by the 'system of federal oversight. Nevertheless, variations in struc- 
ture and priorities are clearly observable. It is reasonable to suspect 
that these variations might influence program productivity. 

U Recognition of National ^WIN Priorit ies 



WIN Sponsor \ 

During the course of our study, awareness of national program 
priorities changed. In our mail survey in the spring of 1977, none of 
the 51 state. WIN coordinators correctly prioritized the four major per- 
formance measures In the WIN Allocation Formula (retention rate, job 
entry wage, job entries per staff and welfare savings). The overwhelming 
majority of state WIN coordinators Indicated that job entries per staff 
was the most important performance measure. This finding was reported 
during; the summer of 197 7. 

Fieldwork conducted in the ten sample states from the fall of 
197 7 through the spring of 1978 yielded a different and changing picture. 
Sevoral states had, in fact, been aware for some months of the relative 
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pr orltles associated with the four performance factors. Other states 
had only very recently received clarification on relative priorities 
through memoranda or briefings by the regional office. Eight of the 
ten state WIN sponsor coordinators either had read the WIN Allocation 
ormula handbook, had been briefed by regional office personnel on the 
ormu a, or both. With one exception, each of these eight described 
t\H' allocation formula performance priorities correctly, indicating that 
the ajmU^ of jobs (retention rate and entry wage rate) were weighted 
most heavily toUowed by the number of job entries. One of the femaining 

nf ^r^f ""k '^^'^f ^^^^ ^^'^''^ something about the formula but was mis- 
tul lZt P'-i-rities, and identified placements as "the name of 

Lht warae. ihe other Knew nothing about the formula and its messages. 

w.^ iH.nJ? ""t^'^^l 'r'"^^ ^'^^^'^ perception of priorities 

was ident cal to that of the coordinator. However, in one state (a low 
per crmer) the coordinator had failed to inform them. His staff had been 
told that placements were most Important. 

Table 7 shows the local WIN sponsor staff awareness of goal and 

Tre ^nd^;^ "HT'T f^^^^'^^^^ in earlier tables the ten sample states 

.re indicated by the letters A through J and arrayed by performance, with 
the high performers at the left and the low performers at the right. 



Table 7 

WIN S ponsor Staff 
Awareness of WIN Go als and Performance Measnrpc 

-A BCDEFGHIJ 

General agreement that quality X X X X XX 

of jobs at least as important 
as number of ji^b entries. 

General agreement that "place- « X X X 

ments" woro paramount. 



The staff in high performing programs had a clearer perception 
Of national program goals. Workers in some of those states described 
train ng sessions or meetings in which they had been Instructed on the 
tormu a and its Implications for their activit^^es. Service deliverers 
T; K r','''^'' Important for them nbt only to place registrants 

In loh. hut also to place them in jobs that hadV longer term prospects 
ind relatively liightT wage rates. r r 
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In two of the states where local staff were unaware of national 
priorities aiui were empfuiHlzlng placement, the state WIN coordinators them- 
selves were not clear about the prioritlest In a third the program head 
had chosen not to communicate his knowled^',e of the formula to subordinates* 
The fourth was a sperlal case, the state described earlier where WIN was 
used to eliminate rhmi f rt)m the welfare roles. At the behest of the state 
program coordinator, local level mi^nagers were preoccupied with "zeroing- 
out" their Al*T)C-U caseload, and relatively less resources were sjient on 
the much more sizeable registrant pool of welfare women* . 

SAr • ' . 

'I'al 8 shi>ws SAl' supervisor and staff perceptions of the program' 
^',oals and per f ornL.ince . With one exception, they v;ere generally Identical 
with those of WIN ^^ponsor staff* In the one state where goal consensus 
between the WIN spx^nsor and SAU did not exist, the WIN sponsor was run- 
ning <\ ''stralglit placenunt" operation. The SAU director knew the national 
priorities and had successfully communicated a concern for quality of 
jobs to SAi: workers thnxighout the state. As a result they spoke criti- 
cally t)f the "numbers game" being played by their counterparts In WIN units. 
Individual SAl' personnel In several other states where the WIN. sponsor 
was or,;p!uis i/, I ng job entries also voiced a concern about quality of jobs, 
but this flowrd from tholr own concern about clients rather than an aware- 
ness of the allocation formula or national program priorities. 

Tablo 8 

SAU Perceptions of 
WIN Goals and Performance Measures 

A B C D K F G H 1 J 



tjualitv ot placements at least X X X X XXX 

as Important as number of job 
vul rl i's • 

Plart'inent Is the rvi jor emphasis. XX X 



■ rhert- were also Important differences In how SAU personnel defe^lned 
the S.V''2 nissl.Mi. Those results appear in Talkie 9. In the four l/igh- 
est ;)i»ri orni n^'. states, SAU supervisc^rs and staff tended to see thei/ func- 
tion nut .nUy as assisting tht* WIN sponsor by providing social services 
t.^ r»^/,l St rant s hut also as (^reatlng coordinating linkages to the VftU and 
I'ltlt^ MX. Hy i-(MUrast> in three low performing programs, SAU workers 
d»'t in»'d thi»ir objtM^tivt* exdusivelv as providing social servicej/and doing 
paM,»rw.»rk t.^r WIN. 



Table 0 

/ SAU Deftnltton of' 

Its Cvn Goals and Mission 

. A BC DEFGHIJ- 

Asalflclng WIN sponsor in moving 
reglsttrants into jobs by providing 
social services, eliminating bar- 
riers atxd acting as coordinating 
link to IMU and Title XX. 
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Providing timely social services 
and paperwork for WIN as requested. 
Not. Important to work with other 
welfare units on behalf of WIN. 

Moving recipients off welfare 
through private sector placement — 
especially AFDC-U cases. 



In three states, the SAU perceived their mission as moving recip- 
ients—especially AFDC-U recipients—off welfare through direct place- 
m.MU activities. One of these was the state described earlier where the 
WIN sponsor also wAs working toward the same, state-ordained goal. In 
this state all. WIN s'ervices were delivered through the state welfare depart- 



A similar but less pronounced situation existed in another state 
swhoro the welfare director and the SAU assigned a high priority to reduc- 
ing AfDC-U caseloads. Vith the reluctant agreement of the WIN sponsor. 
SAb staft In some locations had direct access to the ES job bank and were 
maKlng direct placements of welfare fathers. In a third state, the SAU 
chief had pre.vlously administered Title V and a state-sponsored welfare 
pla.uwnt program. He thought his own organization was more capable of 
the pl.u>.ment function than the WIN sponsor, and the SAU was conducting 
pl:irpment actlvUles in some parts of the state. 

2. Goal Displacement 

nu- >;oaIs and priorities of the "host" organization can compete 
<r displace those of the WIN program. In short, how much do employ- 
ment s.'. urlty and w*-lfare agencies utilize WIN resources and personnel 



to serve purposes other than those of the program? To the host organiza- 
tion » some degree of goal displacement may be advantageous or unavoidable. 
From the WIN program's viewpoint > however, It may lead to diversion of 
resources and reduced productivity. 

Goal displacement took different forms in different states. In 
the cases already described » it meant excessive priority Co reducing AFDC-U 
caseloads. Five other forms of goal displacement (of ten working in 
combination) were also Identified. They involved utilizing the program 
as: 

• A source of general overhead funds for the host agency. 

• A 'Mumping ground" for incompetent personnel. 

• A means of absorbing employment service budget cuts. 

• A source of political patronage. 

• A resource supplement to other programs. 

In two states interview data indicated that a substantial fraction 
of WIN sponsor program funds was being diverted at the headquarters level. 
The amounts apparently involved went well beyond the normal proportion 
of overhead and administrative costs usually chargeable to WIN. Respon- 
dents believed the resources were paying for personnel unconnected to WIN 
that worked in the SESA director's office or other agency-wide units. 

In at least five states the program had served to some degree as 
a dumping ground for inferior employment service personnel. In some cases, 
this had been one of the ways the program had been staffed initially. In 
others, it was a more recent development. Dumping varied from standard 
operational procedure in some states to rare episodes in others. 

In three states the WIN program was used to absorb ES staff cuts. 
In some cases WIN sponsor positions were kept Unfilled to accommodate 
future staff shifts. In others ES staff were put to work on WIN when 
poor ES productivity led to budget reductions under the USiSS resource 
allocativ)n formula* In one episode, a large proportion of the WIN staff 
was laid off to make room for ES staff with more seniority. 

As described in Chapter 3, in half the states in our sample, it 
wan clear that WIN, like other programs, was used as a source of political 
patrona>^,e» Both personnel and capital expenditures were usually involved. 
In the most flagrant cases respondents told of individuals that showed 
up ont» morning with the message they were "told to report to work here*' — to 
the complete siirprlse of the unit manager. In one state, respondents reported 
that all new hires had to b<? cleared by party officials "in the state house" 
and that not only the applicant but also his or her parents' party affiliation 



was checked prior to approval. In four ^states little or no patronage use 
of the program was reported. 

• WIN 'was used as a resource supplement to another program In one 
notable case. The SESA played a major role In service delivery and adminis- 
tration ot cm throughout the state. Agency leadets saw CETA as the 
program of the future and attached high priority to It. Simultaneously, 
they assigned relatively low priority to WIN out of a concern that trying 
to place too many welfare recipients might damage their credibility with 

?^^.rr/n!.,*''"P^°^''" ''"'^ ^""^^ ^^8^ performing mainstream ES operation. 

.KFA/WIN units were organized from the central office to service delivery 
levels to operate both programs. Organizational priorities and structure 
led to the use of WIN-funded staff on CETA functions. In some local units 
Interviews suggested that nearly two-thirds of WIN staff resources were 
used on CETA. , w«iis 

However, this situation was not without some benefits to WIN parti- 
cipants. Due In part to the resource diversion to CETA, the WIN program 
was re atlvely Ineffective when compared to others In its region using 
g.-nerally accepted WIN performance measures. However, at the time of our 
f lo dwork a f. r higher proportion of CETA PSE jobs was going to welfare 
recipients In this state than In any other in our sample. For example, 
m some areas 65 percent of all Title VI-A project slots had gone to welfare 
recipients. Some respondents attributed this fact to the CETA/WIN unit 
structure. From the organization's viewpoint, by putting welfare recipi- 
ents m PSK jobs It was doing something to help them and to address polit- 
ical pressures to put welfare recipients to work. At the same time It 
was able to divert resources to one high priority progran* (CETA) and 
av(»Id hurting another (ES). 

Similar examples of resource diversion occurred on the SAU side, 
especially In states where welfare was county-administered. Some county 
SAL staff whoso salaries were fully paid by WIN funds reportedly were 
used on non-WIN Title XX cas^s or daycare functions. However, blatant 
diversion was less common In SAU's. 

Goal definition and goal displacem,ent were obviously linked to 
othrr Importint constructs. The type of resource diversion to CETA 
just described appears easier If the WIN program Is Integrated into 
other SKSA programs rather than run through Its own separate, self-contained 
strurrure and cha in-of-command . However, self-contained WIN programs 
were no more immune to other forms of goal displacement (patronage, dumping 
and absorption of KS budget cuts) than were those that were administered 
throu.^h an integrated FS structure. The attitudes of top SESA and welfare 
iv.enry ottlcials toward WIN (discussed in Chapter 6) seen more instrumental 



than structural characteristics in explaining the frequency and extent 
of such occurrences. It is worth noting here, however > that analysis 
revealed that in all four of the high performing state programs little 
displacement occurred, while In the declining performer It was substantial. 
In three* of the five low performers displacement was substantial > and In 
the other two it was moderate* 




CHAPTER 5 

STATE PROGRAM STRUCTURE 



This chapter deals with the overall structure of state WIN programs. 
It considers first how big they are, what affects their size, and whether 
size Is related to productivity* Thea it deals with how the program is 
tied to the structure of Its host agencies and how different levels of 
the program'^s hierarchy are connected to each other* 

Progr a m Size 

Program size Is worthy of study on at least two grounds* First, 
size may well affect organizational structure. As the size of an organi- 
zation Increases, management and control problems also grow* This can 
cause the organization to be divided into more units and more administra- 
tive layers* However, this solution has adverse side effects, most notably, 
increased difficulty in coordination and communication among the more 
numt*rous layers and units* 

Larger urgaal-^atlons are likely to have more complex structures*''^ 
This Increased comple:vlty can cause inefficiencies which, iri turn, make 
larger operations les.> productive than smaller ones* On the other h-'nd, 
economies ot sea' e may occur which offset the effect of complexity and 
mako larger operations more productive* 

In th» case of WIN, we first describe the differences in program 

size that exist and the causes oi those differences* Second, we want to 

st*e if differences In size affeci: structure* Lastly, we want to analyze 
the relationship between size and productivity* 

There are Immense variations in WIN program size* In FY 1977 the 
avera>Ao state program had :h9 WIN sponsor staff positions to serve 29,970 
registrants* However, the number of WIN sponsor scaff ranged from 17 in 
one sta^e to 1 , in another* The largest WIN program served 231,000 
r.'x; 1 St rants , while the smallest had a registrant pool of 819* 

*Bl.ui and SiluuMiherr (1971), Chapter 7, showed this to be generally 
trut^ in thi'lr study ot state employment services* 
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similar extremes of varlatton were present in state SAU's* The 
number of SAU full-time staff equivalents^ranged from three in the small- 
est program to 653 In the largest. The average number of SAU staff equiv- 
alents across al' states was 86. 

WIN Sponsor 

« 

Program size as measured by WIN sponsor and SAU staffing levels are, 
ot course, fundamentally determined by federal budget allocations to the 
st'ates. These, In turn, arc most heavily influenced by the estimated number 
ot WIN registrants wUhln a state. In our analysis of the WIN AllocdUon 
tormula, 86 percent of the variation In discretionary allocations to state 
programs In FY 197 7 was explained by differences between states in the number 
of potential registrants.* The entire amount of jnandatory allocations is 
b<i.sea on number of -reg Istrants . 

Kven though WIN sponsor funding is entirely federal, state level 
factors oruld affect their eventual expenditure and thus staffing levels. 
As described In Chapter 3, In half of the sample states general hiring 
t reeves aimed at conserving state revenues couid shrink the WIN work 
for.:e. In addition, the program's capacity to operate near full staffing 
levels was hampered by the speed with which state personnel systems fill 
vacinc les . 

Beyond that, host agency attitudes could affect staffing levels. 
In tK> most extreme case, an ES director who held both WIN and its director 
in l<iw regard directed that many WIN positions be kept unfilled. The 
program^ refirned sizeable unexpended balances to the federal government 
at year s end. As a result, the WIN sponsor side of the program was far" 
smaller than federal officials had intended. In fact, uniquely in our 
sample, the total SAU staff in this state was larger than the WIN sponsor 
Stat I. • 

f 

On the SAU nlde, the situation was even more complicated. While 
WIN Is offlclallvy de.-u-rlbed as a Joint program administered by both DOL 
and HKW, in terms of resources It clearly was not a 50-50 partnership at 
the state and Ircal levels. In FY 1977 and FY 1978, about 30-35 percent 
WIN' funds nationally were to be allocated to the SAU, with the amount 
to he matchtM by state funds on a 90-10 basis. As noted in Chapter 3, this 
meant that the SAU budget passed through regular legislative and executive 
budget review. In several instances, full matches were not approved. 

*MUr1iell et.aj.. ( 1 97 7a), p. 13. 
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In addition, state and county d^oartments of welfare did not approve 
filling of all SAU staff positions In 3t sample states^ Usually this 

was because WIN had low priority wltht-^ the agency* In .some places this 
was because welfare personnel belleveu the main role of welfare was Income 
malnttMiance and saw WIN as part of a social services strategy to which 
they were hostile* Flsewhere WIN was viewed as punitive, unnecessary, or 
useless*' lit such places welfare administrators refused to authorize staff 
positions for SAU or to put social Wv-«rkers into, WIN slots, "feeling that 
such personnel would be wasted* Furthermore, because of the limited role 
tlu» SAU often played In WIN, welfare administrators In many non-metropolitan 
areas assigned SAU workers non-WLN responsibilities as well* 

For these various reasons SAU's in many states were not fully 
staffed* Until unified budgeting for'WIN, many SAU's returned money 
each vtMr to the federal government* However, In some states the advent 
(^f unified WIN budgeting meant that SAU funds that would not have been 
released by legislatures or welfare departments were transferred to the 
WIN sponsv^r rather than turned back to the regional office* Thus, in most 
states there was even less than the 70-30 split that national allocation 
procedures suggest* This was reflected in the relative leadership role taken 
by state level WIN sponsor and SAU officials as well as in the size and 
operation ot local SAU units* 

K t fee t s on Structure 

Analysis oi the organization charts of the ten sample programs 
revealed little relationship between program size and such structural 
characteristics as number of local units and number of administrative layers* 
The effect of scale on number of local WIN units was apparent only at the 
extremes* Thus, the two largest programs In numbers of registrants ranked 
first and third in number of service units, while the two smallest programs 
ranked ninth and tt-nth* Beyond that no patterns were discernible* 

'iLiV.a. .^..^.^^.LLUlil Intensi ty and Productivity 

As noted at the outset of this chapter, program size could be 
hypothtvs I zed to have either a positive or negative influence on WIN 
performance* On the one hand, as program size increases, specialization 
and division of labor could result in greater efficiency* The net effect 
could be Improved productivity. On the other hand, increased scale could 
lead to loss of management control and decreased accountability* Resources 
t»xpen(led on ov ,»rhead functions could Increase at a faster rate than overall 
st.:fflng levels* A smaller proportion of the program's total staff would 
thus be providing direct services to registrants* This could mean a decrease 
In produc t Iv It y • 
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statistical analysts conducted on data for WIN programs In 50 • 
states and the District of Columbia, however, showed no significant rela- 
tionship between program size (number of registrants) and productivity 

job entries per staff).* In other words, large programs on average did 
Just as well In their placement productivity as did small programs. There 
wore no discernible scale effects on WIN productivity. 

Staffing Intensity— measured by staff/registrant ratios— could 
also bo hypothesized to have independent effects on WIN performance. 
A reasonable hypothesis would be that as the number of staff rises rela- 
tive to the number of registrants, the Intensity of services and program 
portormanco also Increase. 

The Issue of staffing Intensity can be approached a number of 
ways. Do state WIN programs have roughly similar staff /registrant ratios'' 
l-f not^.loos the proportion of registrants finding employment in state 
WIN programs Increase as their staff /registrant ratios Increase? Does 
WIN pertonnance— measured by retention rate, job entry wage rate, job *• 
ontries per staff and welfare savings— similarly increase with greater 
staff intt'nslty.' 

Data on staf f / reg l.strant ratios indicate that they vary substan- 
tially i.vi^oss WIN programs. For WIN sponsors, the average number of 
.iuthorl,^..a positions per 100 registrants (for all states) was .85 for 
FY 19 7 7 . with low of .33 and a high of 2.06. Our ten study states included 
ono with :x staff/registrant ratio of .40 and another with a ratio of 
1.7:.. Similar differences existed for S^\U staf f /registrant ratios where 
the nati.Mial mo,.a in FY 197 7 was .55, with the lowest ratio at . 10 and the 
•Ughost .u 1.95. Our study states included a low of .H and a high of 

Consistent with our expectations, statistical analysis of 51 
state programs showed a very strong positive correlation (r=.819) 
between staffing intensity and the proportion of registrants finding 
jobs. staffing Intensity (staf f /registrant ratios) increases among 

state WIN programs, the proportion of registrants that enter jobs 



*"SlKMif i(!anc<>" throughout Part III is defined In terms of a .10 
level ot significance. That is, we would accept as significant the asso- 
ciation between Independent and dependent variables shown by correlation 
analysis if the probability of obtaining a simple correlation that high 
or higher by chance was 10 percent or .less. 
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also systematical ly increases. Thus the disparity among state WIN pro- 
grams on staffing Intensity has a significant Influence on the proportion 
of registrants that enter employment. However, this does not mean that 
by Increasing state staffing levels, productivity per staff would also 
necessarily Increase. 

Analysis of staff /registrant ratios with three of the main WIN 
pertormaucemeasures (Job entries per staff, retention rate and standard- 
ized Job entry wage) showed relatively low and Insignificant correlations.* 
WtUle this suggests a lack of relationship between staffing intensity and 
ovt'rall productivity, results may well depend less on how many staff are 
available than the way In which they are organized and function at the 
local service delivery level. These Issues will be discussed further In 
Chapters 8 and 10 through 13. 

2. Structural Arrangements 

l'iviur>^ b presents two types of WIN sponsor organizations. In 
the example labeled 'Vse 1 f-contalned" the WIN central office relates directly 
to WIN service delivery units through Its own chain of command. In the 
"Integrated" case the formal lines of authority run through the mainstream 
employment service hierarchy. 

Two SAT "or;4anl2at Ion charts are shown in Fi(jure 7. The diagram 
on tlu» ItMt. Illustrates typical SAU arrangements In states where welfare 
programs are operated directly by the state welfare department. The one 



*nur analysis resulted In a strong correlation between staff/ 
registrant rat. lv)8 and welfare grant reductions. However, there Is good 
reason to believe that this was a spurious correlation. First, the only 
way that WIN local staff can Influence welfare savings is by placing 
registrants or providing them with the Incentive and/or job seeking skills 
to find their owii employment. Thus, if staffing Intensity were to influence 
welfare savings, It would have to be through such intermediary variables 
as job entries, job entry wage rates and retention on the job. This is 
not the case since staffing intensity has no significant relationship to 
these in termed lary variables. 

Second, a spurious correl^^tlon might result from both variables — 
staff /registrcUit ratios and welfare grant reductions — being strongly cor- 
rel^^Ued with the same environmental variables. Average employer size and 
population density were two such variables. 
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on the rtftht depicts those arrangements wiiere the county welfare agencies 
have the primary responsi*) 11 1 ty fo? actual service delivery. These four 
diagrams are "typical" in that they represent four types of general models 
drawn trom our examination of ten programs. They permit U3 to discuss 
aspects of organ Uational arrangements without getting bogged down in the 
Intricate details of each of, ten cases. - o 

It should he i/nderstood that no' one state in this study conformed 
ports^ctly t.) \ particular diagram. For, example, "self-contained" and 
^ Integrated" structures co-existed In one state program wliere the 
WIN coordinator hid line authority over most of the local units but not 
the verv large metropolitan ones. Similarly, county welfare agencies 
delivered services in most of another state, but programs in one large 
metropolitan county were directly operated by the state social services 
department. In ,i third state the SF.SA was only the titular WIN sponsor. 
Both WIN and SAi; functions were delivered at the local level by the welfare 
agency. 'TaMo 10 shows host agency arrangements for 51 WIN programs and 
the ten tates in this study. 



^"ablo 10 

WIN Sponsor and SAU Host Age n cy Arrangements 

Nat ionally Ten Study Stat es 

•i I? 'I' 'I'i'.ir. A'"f ■ttMement 

• Separate self-contained WIN structure 12 4 
within tlie SKSA. 

• 

• WIN Integrated Into the FS structure 36 5 
within the .^KS/\. 

• Other 

— SRSA is sponsor, operations sub- 1 1 

^:ontr.u'ted to welfare department. 
— (lOVernor's manpower office Is 1 

sponsor arid admin 1st rator. 
— State planning office is sponsor, 1 

operation*, subcontracted to SKSA. 

fi"^. A r rangement 

• SAT in a state-administered welfare 32 5 
pr(j>^ram^ 

• SAT in a t^ounty-admin istered welfare 19 
pr{)>;ram . 
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HuBt bureeui 

Within the* SKSA lieaclqiuirCers , the WIN central offices in the states 
studied wt*re most frequently housed (live cases) in the same bureau as 
CKTA services atul Job Corps* In three i^ther states the WIN central office 
reported directly to the director of the employment service. In one case 
the pro^^ram had equal organizational standing with the ES and Unemployment 
Compensat li')n, the WIN director reported directly to the SKSA executive 

director • 

Within thi' state welfare department, the SAU was usually located 
(seven rases) in the division that liad responsibility for the Title XX 
prc^Kratiu hi three states the SAU was in the same division that planned 
and tiprrated a state workfare program for recipients of general assis- 
t<in<.e. In sever<il cases the host bureau administered sp^:>ciai target group 
(mlK.rant, retu*;ee, native ^Xmerican) programs or vocational rehabilitation. 

Our analysis stioWed no relationship between host bureau location 
and program perfonnance* With few exceptions the location of the WIN ' 
proy^rain within tlie SKSA or state wel fare 'department did not appear to 
attest Its 1 inkavAes to other employment or welfare programs* 

V i\r t i r e 1 1 1 i n k c 

Si'.nilarlv, we found no relationship between program performance 
and tht* <^r>.Mn l/at ional *Mistance" from the WIN and SAU central offices 
to their host i.'ency's executive director. One state WIN coordinator related 
directly to the SKSA executive director. The others were separated by 
betwt»en one and fnree administrative layers. Only one SAU head was immedi- 
ately below the key operational officer in his agency. In jnost cases, 
a siiv. le administrative layer (the social services division chief) separated 
tht^m. tlowever , in twc^ instances there were at least .three intervening 
ind iv iduals . 

Wiere WIN ^M^'-' ^^^t ions were integ rated'* within the KS chain of 
I'omniatul , the t'«^rmal line of aut^hority to the local level might include 
tlve to sever) individuals. Communications might first flow upward in the 
c-entral t^t t uh' throu>',h a .manpower program coordinator, the ES directpr 
and a field .operations chief. Then messages might move downward to the 
field throui.0^ .in KS area administrator and an KS local office manager before 
reaching a WIN unit supervisor. In some cases, this pattern was supplemented 
bv extensive informal but direct communications between state level and 
^•)cal WIN [>ersonnel, I nc 1 ud Ln>< frequent telephone conversations, field . 
visits and ineetin>'.s. In three states studied, roving **field specialists" 
were used i^l/irity c-ommun icat ions as well as provide technical assistance. 



Wier« WIN was "self-contained" in the SESA, matters were usually 
simpler. On administrative matters such as office spacj and final person- 
nel actions, the state WIN coordinator still had to--C?oTlc through the SESA 
hierarchy. However, on substantive program issued his or her authority 
ran directly to WIN workers Ip the field. With one exception, communl- 
oatluns passed through no more than one other layer (an area or district 
WIN supervisor) before reaching the local unit supervisor. ' 

On the SAL' side, differences between, state and county-run systems 
wore notable. In the five state-run welfare systems we studied, the state 
SAI coordinator related directly to service deliverers, usually through 
area supervisors. In three of these, the SAU coordinator had formal line 
authority over field staff. In the other two states, the coordinators 
had intormal but direct kiv.es of communication on SAU matters, even though 
tormal lines of authority ran out to the field through an agency-wide 
field operations office. 

In the five county-run welfare systems, however, the situation 
was dltterent since the "sovereignty" of the counties had to be consid- 
ered. In two ot these states the SAU coordinators were independent within 
the state welfare system and could communicate directly to the field. 
However, this meant that they had to relate separately to each autonomous 
ro.mtv welfare director and that they could communicate with SAU service 
deliverers ouly through county officials. In the other three county-run 
states, tonnal communication to the field went up through the state welfare 
a«oncv and down through formal field operations to county welfare boards 
or directors. The SAU coordinators and their area administrators were 
k.-enly iwire that they had no direct authority over local staff. Their mode 
ot bc'havlor reflected the fact that they had to rely more on persuasion 
and advice than direction If they were to achieve their objectives. 

)b!.r. l^.eiltii L AlJllt- r e n t i a 1 1 o ii 

The term "horizontal differentiation" refers to the number of units 
• It each level within an organization. In eight of the ten WIN sponsors 
and seven SA!''s. some area or district level existed. Within those eight 
the number ot area level administrative supervisors ranged from a high 
"t ten to a low of one. The number of sponsor service units ranged from 
XX to t ivc. The number of units was reportedly influenced not only by 
program size hut also by geography, the size of registrant pools in par- 
ticular counties, the receptivity of county welfare officals to WIN, the 
availability of space In KS offices, and the preferences of WIN management 
rckMrdln^ small or large units. 

The number of local SAU units tended to be a function of one of 
two ta.- tors— the number of WIN sponsor units or the number of counties. 
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.WlK-re wultare vAis state-run, the number of SAU's tended to match the num- 
ber of WIN units. Usmdly. one SAU unit and one WIN unit were a service 

•del Ivory pair. In states where the counties administered welfare, most 
count IvH \u\d at least one Individual responsible for SAU functions, so 
the number ..f sAU "units" tended to be larger. In counties with more 
than one lo.^il WIN unit, SAU staff might have dealt with more than one 
sp..n.sor ottic-e. Or. whc^ a local WIN office covered more than one county, 
sp.>n.sor statt may have ha\ to coordinate with more than one coupty'SAU. 

Dtt teron.-t-s in horizontal structure, like size and vertical con-/ 
tlKurati.v.-i, did not .appear to be systematically associated with variatlc^n 
111 per l ormaui-e . ^ 
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CHAPTER 5 
LEADERSHIP AND MAiNAGEiiENT- 



This chapter examines state-level program and organizational leader 
ship. We must consider both program and organi zational leadership because 
state WIN programs are not autonomous. They are part of much larger organi 
zatlons with far bigger programs. The attitudes and priorities of the men 
and women who preside over those employment security and welfare agencies 
may be as crucial to the program's success as the characteristics of the 
WIN program directors themselves. The chapter is prgauized to answer six 
questions: 

• Wio are state WIN sponsor and SAU coordinators? 

• How do they conduct management functions? 

• Wuit are their management styles and methods? 

• W\\al are the characteristics of the program's staff? 

.. H»w do the sponsor and SAU coordinators relate to each 
other? 

. How do the leaders of host organizations Influence WIN pro- 
grams? 

In the course of answering these questions, patterns will be identified 
tliat appear to Unk program performance to various aspects of leadership 
In combination with other organisational characteristics. 

^ • Who Are Sta te W IN Sponsor and SAU Coordinators? 

Kducat lon al B ac kg round 

The WIN sponsor coordinators in our ten sample staj^^ were ex- 
tremely diverse in disciplinary background. All had coll^l.rlegrees . 
They included individuals trained in public administration'/'Vsychology , 
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divinity, textile design, law and accounting. The SAU coordinators, how- 
.ever, were^ somewhat more homogeneous. At least half held both' bachelor's 
and master's degrees In social work or sociology. 

P rior Work Experience 

All were long term employees of their agencies and very experi- 
enced In wotking with welfare recipients or the disadvantaged. Only one 
WIN sponsor coordinator had worked in the employment security agency less than 
ten years. The SAU coordinators had from six to 25 years of experience 
In social services. Strikingly, despite their relatively long tenure In 
the SKSA, only two of the sponsor coordinators had extensive experience In 
mainstream employment service operations. Most had worked almost exclu- 
sively in prior human resource development (HRD) , OEO or youth programs. 
All ot the SAU coordinators had either. been Title V administrators, county 
wt'ltare administrators, caseworkers or staff In training programs for 
the disadvantaged prior to joining WIN. 

P olitical Connectio ns 

With only two exceptions, none of the SAU or WIN sponsor coordina- 
tors in our sample were reported to have personal connections to a political 
or community constituency outside their agency. The circumstances of 
their appointments suggested that none could be termed either "political 
oxooutives" or patronage appointees. In short, all were career civil 
servants. 

iih_L*i. J .e aJership 

Wl\at is remarkiible about these program heads is their length of 
service In their current positions. In sta' agencies wliere turnover, 
lateral and upward movement Is sometimes high, this group of individuals 
had stayed in the same place a long time. Only three of the ten WIN spon- 
sor coordinators had been in their jobs two years or less, and one of them 
had previously been nn the WIN central office staff. On the SAU side 
stability was oven greater— only one state coordinator had held that job 
less t'uan two years. 

With roUtive longevity on both sides, the effect has been to 
create stable "pairs" of leaders for the program. In four out of ten 
cases the SAU and WIN sponsor coordinators had been a pair since the be- 
ginning of the program or the creation of the SAU. In another case they 
had been together five years, and four others about two years. 
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How Do They Conduct Management Functions? 



Mcinagement of a program such as WIN Involves the performance ot^ 
certain explicit tasks* How these tasks are conducted may well have an 
important Impact on the program's ev^-ntual perfonnanee. Figure 8 ix)rtrays 
the main tasks of the WIN and SAU central offices and state coordinators, 
as Implied by the WIN Handboo k, These functions may be summarized as; 

• 'A;()al definition. 

• Plannlnj^ and budgeting. 

• Training of managers » supervisors and staff. 

• Operation of reporting systems. 

• Monitoring and evaluation. 

• Coordination with other relevant programs and 
organizations. 

Chapter 4 has already examined the Issue of goals, and Chapter 3 has dealt 
with state-level Interorgani zat lonal coordination. Here we deal with the 
way In which state coordinators and their central office staff execute 
their planning/budgeting, training, reporting system, and monitoring/ 
t'val iiat inj', responsibilities* The functions of intennedlate layers of 
ndmliilHtrat Ion , ^uch as area offices, are also discussed. 

jibjlli?;,^ng and B udget inj> 

L^Mifral office interactions around development of the state plan 
varied greatlv. At one e.^Liemf.* were four states (three high performers 
M\d the low performer that emphasized AFDC-U) in which SAU and WIN sponsor 
personnel mi^t frequently and t-ogether developed a single plan, incorporating 
riimplementary WIN sponsor and SAU activity estimates, goals and functions. 
At the other extreme were four programs (three low performers and the de- 
clining pertormer^ in which WIN and SAU central office staff had minimal 
contact. The»y met the bare minimum planning requirements, simply sub- 
mitting as their plan the compilation of independently estimated activity 
level? gent»rated by the two units. In fact, in one case the WIN sponsor 
and SAl' submitted separate plans. 

Between these extremes were two programs in which SAU and WIN 
sponsor statt conferred about the state plan. In one case they functioned 
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as equal partners, developing separate documents and then coming together 
to correct Inconsistencies and merge the two parts Into a single plan* 
In the other case, the SAU central office was understaffed .and unable 

to take Initiatives without clearance f;:om superiors* The WIN sponsor 
took the lead In developing the plan— even to the point of obtaining the 
Inputs of local §Ml as well as WIN sponsor units* 

Similar extremes were apparent In the unified budget process * 
In three high performing programs the .two coordinators or their staff 
discussed funding needs together* They linked funding to activity es- 
timates, new priorities and Innovations in their annual plan and agreed 
on a division of funds that satisfied both parties* At the other extreme 
was a low performing program in which the WIN sponsor and the SAU, for 
whatever reason, saw no need to meet, discuss or negotiate* They simply 
split the budget in the same proportions as they had in the past* 

In six states budgets were either (1) split on the basis of past 
spending patterns, (2) adjusted so that the sponsor could have funds that 
the SAU might otherwise turn back or (3) divided according to regional 
office suggestions. In two cases, the central offices Invested some time 
and effort In this process, but In the others it seemed almost automatic* 

Local WIN sponsor Involvement in planning processes also varied, 
as is shown in Table 11. Some form of genuine "bottom-up" planning was 
occurring In four WIN sponsors, three of them high performers* In those 



Tai)le 11 

Local WIN Unit Invplvoment in Plaruiing Prcxjess 



Bottom-up planning* 

Local Input to 
estimate derivation. 



B 



H 



X* 



After-the-fact input 
to estimates. 



X 



X* X 



Top-down quotas. X X 

*Dlfferent type of involvement in different parts of the state 



83 



99 



cases the WIN cental office Informed local units about the planning process 
and program Issues fox cha new fiscal year* Local offices were expected 
to provide their est^lmates of activity levels, and flnil planning targets 
were negotiated between levels. 

In all of one State and part of another, local units provided 
estimates of activity levels but might see them changed significantly 
without negotiation or an opportunity to register their concerns. In 
three other cases local units were given planned activity levels by 
superiors and asked for their suggestions, but there were Indications 
that their inputs were not taken seriously. In two Ftates no local in- 
puts were sought at any stage. Local unit supervisors were simply handed 
activity quotas by their superiors. 

A similar range of Involvement was present in SAUs. In three 
states bottom-up planning prevailed, even though this was complicated 
by the fact that two of them had county-run welfare systems. In three 
cases (all high performers) local units were asked only to comment on 
the overall State plan or on central office expectations for the unit's 
performance. In four States (including three low performers), there were 
no local SAU inputs whatever to the annual plan. 
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Training 

t 

Table 12 Illustrates the contrast in amount and variety of train- 
ing that tended to differentiate high performing from low performing pro- 
grams. A glance at the table tells much of the story. As the eye moves 
from left to right, from high to low performers, the amount and variety 
of training declines substantially. 

A closer examination reveals between 18 and 22 different types 
of training in five programs (the four high performers and the AFDC-U 
oriented program) . In four of these states many courses were conducted 
Jointly. Considerable WIN-speclflc training was provided. In two of these 
states, procedures had been developed to identify demand for various types 
of training and to obtain feedback on the quality and usefulness of the 
training. WIN central office personnel took an active part- in this train- 
ing. Two high performers had formally designated WIN trainers in the 
central office. In the other cases training was provided Jointly by 
central office staff and agency-wide trainers or by agency-wide trainers 
using curricula developed in collaboration with WIN officials.* ° 



*ln addition, at least half the States utilized outside trainers 
from universities or private. firms in some capacity. 
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Table 12 

Types of Training Providead vitu Sponsor and SftU Staff in Ten Stiriv States* 



Tydm of TratBtM 



Tr ti h lng on ^rograa Proc«durta and Functions ; 
G«n«rtl WIN Prcc«dure« IrAining 

ms (or Ueveiopft«nt of job seeking gkiils) X Joint 

' Joint Appreieel X Joint 

Caeeioed Msnegcment (WIN Sponsor) X 

Ceeeioed Management (SaU) X 

Client Need* Aaaeaaaent X Joint 

Adjudication Proceaci X Joint 

Employer Contacts/ Job .Development X 

OJT/PSE Contact Writing anJ MonitorinK X 

Ways of Improving Coordination Between X Joint 
SAI'/WIN/IMV 

WIN Orientation (extensive, 1 week or more) X 
WIN Orientation (lews than a week) 

General Skill Enhancement Training ; 

^'Psychological Skill*' Upgrading X 
Interviewing/Counaeling Techniques X Joint 

"Coping ifith Stress'* 

Hostile Client Approaches 

**Reality Therapy" 

Motivation Improvement Clinic 

Formal CroS9«*Training on Other WIN X 

Tasks and/or S£SA or Welfare 

Functions 

Report infit Monitoring and Evaluation System Training ; 



ESAKS and Error Corrections Instruction 
Special JSMS Training for WIN Staff Only 
JSMS Training for all SESA Staff, 

including WIN 
New DOT Retraining 
Form Completion 

WaF and Krey Performance Indicators 
Terminal Data Transmission and Access 
to Client uata oaaes (WelUre) 

Training in **Toplcar' Areas : 



X 
X 



"Hi 



t(on-*Tradltiotval Jobs for Women 



Equal Employment Opportunity 
Judge Richey decision 

Management and Supervisory Training ; 
General Management /Supervisory Ski lis 
Financial Management Training (WIN) 
Financial Management Training (SAU) 
"Value Systems** foV Managers 
HBO Training 

Team Management and Problem Solving 



Informal 



X 
X 



Every 6 mos 



X 

X £S 
X Joint 



Formal 
within ofc. 



X ES 

X for SAU 
by Welfare 



X 

X 

X 
X 
X 



quarterly 
semi-annually 



X 
X 
X 
X 



X Joint 



X Joint 
X Joint 
X £S 
X 



X ES 



X 
X 



X WIN 
X WIN 



X 

X WIN 
Informal 



X Joint 
X Joint 

X 
X 



X Joint 
X Joint 



X Joint 
X Joint 
X 
X 

X Joint 



X 
X 



3 day session 
X 



X 
X 

Informal (memo) 



one euperviaot 
^(out of state 
training) 



one SAU spvr 



Tally of Types of Training Z2 18 20 ' 18 2 

(7 Joint) (1 joint) (5 joint) (5 Joint) (single staff trng) 

(0 Joint) 



*DatA on cypea of training provided WIN staff were drawn from interviews with SESA, WIN and SAU officials knd staff 
at the state, area and local program levels. If staff in more than one local office indicated a specific type of training 
had been provided in the past 12 months (verifying central and area office information) an "X" \vis been placed in the 
respective state's column. These tabulations only reflect the incidence of training, not its quality, or perceived • 
usefulness. If an aRency other than the WIN sponsor provided the training, their abbreviation is provided In the column 
U.e. . ES— employment service, R(w-federal rej^ional office). Joint SAU/WIN training sessions are*identif led by the word 
"Joint Most traininK on reporting systems is normally provided by the ES, so where WIN staff actually provided such 
training it Is so indicated. Incidences where training was received by only a few staff arc so annotated in the table. In 
addition to an initial question on tralninR received, interviewees were asked other exploratory questions about tcf.ining to 
facilitate their recall of events durlnR the past 12 months. ' 
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Table 12 

^fypes of Training Provided WIN Sponsor and SAU Staff in Ten Studty States^ 

(Continued) 



X 
X 

X(W*sUare) 
X (Welfare) 

X ' 

X 
X 

XCWelfare} 
inonch(Welidre) 



Planned* Joint 

X one otc 
X one otc 

X £S 



X 

X Joint 



X RO 



X RO 



X Two General office scaff 



X £S 



X RO 



X 
X 

X (Welfare) 



X Joint 

X For SAU on Welfare 
functions 



X for SAU on Welfare 
functions 



X 
X 



X 
X 



X 
X 



X 
X 



X 
X 
X 



X 
X 

X Joint 



K £S X £S X £3 X some mgrs 

X Joint 
X Joint 



X ^-3 iay 
sessions 
per year 

19 3 11 7 4 

^atnce SAL" (Q Joint) (3 Joint) (2 Joint) (0 Joint) 

.md WIN in ■Jtime 
welfare v>t\- -j 
mostiv Joint 
tialnlng} 
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In the remaining five cases* the situation was qalte different. 
The variety and frequency of training viere noticeably lower. In two of 
these states timers was little eaphaslt* on staff training In the SESA In 

general. Nelt|^er WIN sponsor nor SAU staff had received any formal, program- 
specific training recently. In three other states some training was pro- 
vided. However, the training was rarely WIN-speclfic and was sometimes 
reported to be of limited utility. WIN sponsor and SAU personnel occa- 
sionally attended some form of general agency-wide training that was usu- 
ally more oriented to the needs of their agency's other programs. 

Reporting Systems 




The ability of federal as well as state and local WIN managers 
to make management decisions based on information rather than subjective 
impreasioas hinges importantly on the accuracy and timeliness of reporting 
systems. Since federal allocations to the states are heavily based on 
reporting system data, such data is the financial lifeblood of the system. 
Thus, how well WIN central offices operate reporting systems is not only 
an indicator of their competence. It also affects how their program's 
performance is perceived by federal officials and how large a budget it 



Table 13 shows the status of ESARS In the ten sample WIN sponsors. 
As can be seen, high performers had relatively few problems with the system, 
while low performers tended to have more. 

In two states (both high performers) , there were only minimal 
problems. Data accurately reflected local unit activity levels and were 
generally used in management of the program. In those cases where hand 
tallies were kept, they were used only to verify ESARS accuracy. In four 
others (two high and two low performers), problems such as undercounts 
and overcounts existed, but procedures for correcting errors had been 
established and were being followed, and by the end of the fiscal year 
data was accurate. Hand tallies were maintained only to Identify ESARS 
problems. Rarely were they used for managing the program, in two other 
low performers, ESARS data were quite inaccurate, and hand tallies were 
used as a more timely supplement to ESARS at both the state and local 
levels. The situation had Improved somewhat In the past year. Finally, 
in two WIN sponsors (one declining and one low performer), ESARS was viewed 
as a hopeless problem that was beyond the control of WIN management. 
Hand tallies served as the only operative management information system. 



The intensity of problems was related to how the state coordinator 
dealt with the management of reporting systems. In one state that had 




receives . 
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Table 13 
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all local projects. At the 
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its first year of 
end of the fiscal 
be maintained . 


ESARS 
year 


implementation for 
transition period. 













89 

ICS 



relatively few p^obleins, WIN funded a system analyst and programmer to 
maintain full-time reporting system services for WIN. He attended all 
WIN central office staff meetings, provided teportlng system training and 
Instructional material for Ictcal WIN staff and performed technical as-' 
siatance for individual local units. Three others funded a SESA reporting 
system apecialist who attended WIN central office meetings and Interacted 
closely with central office staff while providing training and technic^ 
assistance. Conversely, the four WIN sponsors with the most severe prob- 
lems had given responsibility for ESARS to a clerk who had little Inter- 
action with the SESA's reporting systems specialists. Ironically, one 
of these was in a SESA that was among the mAst competent in the country 

employme nt service reporting. However, this SESA accorded WIN low 
priority. 

In the four high performing programs, SAU and IMU reporting systems 
were generally accurate and problem-free. Information on obtained employ- 
ment and welfare grant reduction, important to the ovferall achievement of 
their program under federal performance measures, was being captured and 
reported directly to the WIN program. One of these programs was planning 
access to an automated reporting system. 

Another program (a low performer) already was on such a system, 
but problems in the system were causing inaccurate counts on activity 
levels. This was the state where the welfare agency had both VIN sponsor 
and SAU responsibilities, and information on job entries were tabulated 
through the agency's system and then transferred to ESARS through an in- 
terface program. WIN data processing was given low priority, and state 
systems analysts could not work with the interface program since it was 
poorly documented and developed by an outside contractor. 

In the remaining four programs (three low and one declining per- 
former) , problems were more serious. In two of them, undercounting on ob- 
tained employment and welfare savings occurred in some places due to poor 
linkages to iMU's but not in others. In the other two, underreporting 
or other Inaccuracies were endemic due to troubled relationships between 
WIN and IMU's. 

Linkages between the WIN sponsor and SAU/IMU reporting systems 
varied. In three high peformers, there was a computer interface between 
the two data systems or regular exchange of data tapes between organiza- 
tions to identify and resolve data problems. The interface mecha-nism 
was perceived to be working. A fourth state had a similar approach but 
had yet to overcome serious interface problems. Two other states made 
manual comparisons of data in the two systems to identify possible co- 
ordination problems in reporting between the two organizations. Finally, 
In four programs (three low and one declining performer) interfacing was 
minimal or non-existent. 
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Monitoring and Evaluation 



Table 14 shows the type of monitoring performed by WIN sponsors 

in the ten sample states* Central offices in high performing programs 
tended to undertake a more intensive and sophisticated monitoritig process* 
Each of Che central offices that monitored intensively looked beyond planned 
versus actual activity levels. They made extensive use of ESARS^ CAS 
or other data to identify areas requiring attention. Each used a somewhat 
different mix of methods > including: 

• Maintaining a relative performance ranking for each local 
unit in the state on a monthly basis. 

• Monitoring operational data on local units daily or weekly» 
with the personal involvement of the state WIN coordinator. 

• Maintaining and reviewing fiscal tracking reports by ar^a 
or unit. 

e Analysis of a wide variety of ESARS, CAS and other data to 
identify specific problem areas within local offices. 

• Local office "self-appraisal" combined with "field tech- 
nician" visits on a monthly basis. 

• Field monitoring that scheduled central office personnel 
to visit each local unit on a quarterly or semiannual 
basis. 

• Joint SAU/WIN sponsor monitoring visits to both local 
sponsor and SAU units. (In three states this was formal 
policy. In three others it occurred occasionally.) 

• Field visit techniques that involved thorough review 

of procedures, paperwork, management practices and per- 
formance and that Included feedback to ^ and comments by^ 
both local supervisors and staff. 

By contrast, in two other states WIN central office personnel 
might look at certain ESARS items, but analysis was minimal and site visits 
were infrequent. In another state, little analysis was also performed, 
but the WIN coordinator made frequent field visits. These, however »yere 
largely formalities that involved little review of office procedi; 
functions, no feedback to the unit on ways of improving and no lni,>ii:action 
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Table 14 

Type of Monitoring Conducted bv WIN Sponaora 



^ BCDEFGHI J 



A. Central office staff 
continually review 
data on local units 
to Identify problems. 
WIN coordinator per- 
sonally Involved* 
Frequent syakematlc 
on-site monitoring of 
local units. Site 
visits detailed and 
broad-rang Ing . Feed- 
back to local units. 



(only recent) 



. Monitoring data col^ 
lected at central 
office, but little 
or no analysis to 
Identify problems. 
Some local unit 
visits. Site visits 
either unanalytlc or 
narrow In focus. 
No feedback suggest- 
ing Improvements. 



C. Infrequent visits 
to LO's, and less 
use of monitoring 
to improve opera- 
tions • 
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between the state coordinator and Service, deliverers on program Issues. 
Finally, In two other states the state WIN coordlnatorjs devoted almost 
no tine dr effort to monitoring local program data, analysing local op- 
erations or field visiting. 

SAU state level monitoring tended to fall into the same three 
categories. Four state SAU coordinators (all in high performing programs) 
engaged in an on-going, intensive process including extensive data feview 
and analysis as well as thorough field visits. In three of these cases, 
local reviews were generally done Jointly with WIN sponsor and regional 
office offLclals. In three other states analysis or field visits were 
more limited. Finally, in three low performing programs, data review 
and analysis were minimal, and field visits were infrequent partly be- 
cause of -understaf flng or limitations on travel. Monitoring and opera- 
•tlonal improvement was left either to local supervisors or to county 
welfare agencies. 



Use of Area Admlnlatratlve Levels 

Table 15 shows WIN sponsor area-level arrangements in the ten 
study states. In eight of the ten, some intermediate level existed between 
the state and local, levels. Only the two smallest programs had no inter- 
mediate layer. 



Table 15 
WIN Sponsor Area-Level Structure 

AB CDEFGHI 

WIN Integrated Into ES 

chaln-of-'command 

ES area structure only X 

ES and WIN area structure X* XX 

CETA/WIN area structure X 

Self^-contalned WIN programs 

WIN area structure X* X 

No area structure X 

WIN opeyrated by state vel- X 
fare area level 

*WIN program was self-contained in most of the state but inte- 
grated into ES chain-of -command in several metropolitan areas. 
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In the one high performing program where only an ES area structure 
existed, top SESA leadership had made it clear that WIN was a priority 
progran, and ES area officials rarely Involved thenaelvea in th« program. 

Local WIN managers said that they worked through the ES area office on 
office space, personnel actions and reporting system problems but that 
they could communicate directly with the WIN central office on program 
policy and procedure* 

Each of the three cases involving both an ES and WIN area structure 
was different. In two states there was a WIN unit within each area ES 
office. In the third, there was a cadre of WIN "field technicians" with 
separate geographic responsibilities as well as ES area offices. In two 
of these states SESA leadership was supportive of WIN, and their attitudes 
were reflected at the area level. In the third, top management was hos- 
tile, as was the ES area structure through which WIN was administered 
In part of the state. Although overall state performance was high, its 
poorest performing local units were In these ES controlled areas. In each 
of these three states, WIN area supervisors or field technicians played 
an active role In providing technical assistance and policy guidance. 
Their presence helped overcome linkage problems that might otherwise have 
occurred because of the Intervening layers of ES structure. 

The low performing program with the CETA/WIN structure has already 
been mentioned. Because of the high priority this SESA gave CETA and the 
low priority assigned to WIN, area CETA-WIN coordinators devoted nearly 
all their attention to CETA. They generally lacked detailed knowledge of 
WIN policy or procedures, and they provided neither technical assistance 
nor oversight on behalf of the program. 

Of the three self-contained programs with their own area struc- 
tures, the high performer had an active, knowledgeable cadre of area per- 
sonnel. They not only provided technical assistance and policy guidance 
but also functioned as a conduit for lateral contact across local units 
and candid upward feedback from the field to the state. of flee. In the 
two low performers, however, these Individuals played a more passive role, 
primarily serving to pass directives downward and routine paperwork upward. 
They provided little technical assistance and, tn one case, rarely visited 
local offices. 

Seven of the ten SAU's also had some Intermediate level adminis- 
trators between the state coordinator and local offices. This was the 
case In three of the five states where welfare was county-administered. 
These individuals had a particularly difficult and delicate job.' Local 
.SAU workers were usually county employees, thus not under their direct 



94 



aupervlBlon. Personnel clAsslf Icatlone and salaries sometimes varied 
from one county to the next* In some states county welfare departments 
used their own reporting systems^ and there was iio^unlfomlty In reporting 

of welfare savings and obtained employment or other Information* In addl^ 
tlon, county welfare administrators controlled SAU budgets and staffing 
levels* 

In these cases i SAU area staff necessarily functioned more as 
"liaison" or "coordinators" rather than "managers*" In two of the high 
performing WIN states* the SAU coordinator and their field staff suc^ 
cossfully established positive relationships with the counties* One of 
these state SAU's had regional directors who transmitted Information to 
the counties and to local SAU workers* Many of the counties in this state 
had negative attitudes toward WIN, and these regional SAU directors con- 
sciously worked at Improving relationships between the WIN program and 
local welfare officials. The other SAU took this field liaison role 
further. Including county IMU supervisors In regular WIN area meetings 
with SAU and WIN sponsor local and area staff* By widening communications 
and including county welfare supervisors In procedural decisions » linkages 
important to the program were strengthened* 

Our analysis showed that high performing' state programs in our 
sample had area sponsor and SAU staff with extensive "WIN program experience 
actively providing technical assistance and creating important linkages 
In the field* The program usually also received some degree of priority 
within ES and welfare district structures, if they existed* There was 
no similar consistent pattern among the low performers* Either there 
was no priority in the ES district structure (one state) or ineffective 
and poorly utilized separate WIN area staff (two states)* In the one 
low performing state where the sponsor was integrated into the ES struc- 
ture, the SAU had a very well organized area supervisory system which 
provided monitoring and technical assistance* However, the program had 
very low priority In the SESA* 

3* Wtiat Are Their Manajsement Styles? 

* The management style of state WIN sponsor and SAU coordinators is 
demonstrated In large part by their behavior in executing specific functions. 
As we have noted, their approaches to planning, training, reporting systems 
and monitoring varied considerably, and those variations tended to dif- 
ferentiate high from low perforrilng programs. 

Now we turn to another set of constructs which partlv cross-cut 
these specific functions. They include aspects of internal management 
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(i.e.. delegation of authority to aubordlnates, decision-making proceaaea. 
and communication methods and patterns) and relations with tha '*othat 
alda of tha program (the SAU or WIN iponaor) and with hoat organisation 

leadership* 

WIN Spons or—Dele g ation of Authority 

The Job of a program manager may be defined as assuring that program 
mandates are carried out and that decisions made within the organization 
are consistent with these mandates. Thus a manager delegates optimally 
by permitting discretion to the .)olnt where he or she can still have con- 
fidence that decisions are being made In this way. Any less is inefficient. 
Anymore and thij desired degree of uniformity Is lost. 

Theoretically, then, the proper degree of delegation may be 
determined by (1) the nature of a program's tasks, (2) the competence 
and other characteristics of Its work force and (3) by the scale of the 
operation. The more variable and complex the tasks, the more discretion 
required for efficient functioning. Similarly, the more competent the 
manager s subordinates, the more likely they are to make "good" deci- 
sions. Lastly, as noted earlier, the larger and more complex the organi- 
zation, the harder It Is to control or coordinate, and the more imperative 
delegation of authority becomes. 

It follows from this that If a manager wants or needs to permit 
considerable discretion at lower levels of the organization, he or she 
must communicate and train the staff In the ways he or she thinks are 
appropriate to act and decide. And he or she must have accountability 
an d feedback systems that permit the monitoring of actions, results and 
problems. Thus, the Issue of delegation Is Inextricably related to the 
Issues of communication, training, reporting systems and monitoring pro- 
cedures discussed earlier. 

Across our ten-state sample, both WIN sponsor and regular ES 
staff reported that the delegation of authority was generally more 
extensive In the WIN program than elsewhere In the employment security 
agency. This meant that area level administrators, local unit managers 
and even individual service deliverers were perceived to have more dis- 
cretion than ES personnel in adjusting operating practices, managing 
their time ami relating to other programs or to employers. This was 
partly because the tasks of the program were seen as more difficult and 
variable. They Involved more disadvantaged clients, a greater variety 
of services and a more complex set of Interactions with other organiza- 
tions. , 
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In seven states greater discretion also resulted In part from 
the state coordinator's management strategy* In five of these states, 
the coordinators and their central office staff emphaaited the importance 

of "training staff so that they can make decisions for themselves, V 
••providing flexibility and autonomy at the area and local level," "man- 
aging by exception," or "delegating responsibility downward •" In most 
of these states, substantial efforts were being made to train personnel, 
to develop mechanisms for upward or lateral common Ic at ion t and to provide 
technical assistance. In the other two, discretion was not due to a con- 
scious policy but rather to the passivity of the state director • Training 
and monitor lag were minimal in both of th<»fee states. In, the absence of 
training, communication or control systems, local personnel were relatively 
free to operate as they wished. 

WIN Sponsor— Declsion-makln^^ Processes 

Decision-making In an organization may be centralized or de- 
centralized, unilateral or consultative, hierarchical or participative. 
It may vary with the circumstance or the organizational level or unit. 
Here we are concerned with the general pattern of decision-making reported 
at the central office and area level. Do state coordinators as a regular 
habit make decisions alone, or do they Involve central office staff, area 
staff, and local managers In the decision process? At the area level, 
are local managers Involved? 

Four states (two high and two low performers) had both a policy 
of participative decislon-^maklng and structures for implementing It. 
This involved what one manager called "group process management style." 
Through frequent meetings, field visits and telephone conversations, the 
state director and central office staff consulted field personnel prior 
to making decisions. At the area level as well, regular sessions, monthly 
or more frequently, were held that included open consideratioi: of problems 
and proposals. Three were states in which "bottom-up" annual planning 
occurred. Of the low performers, oue was a program wliere the WIN coor- 
dinator was new, and this approach was a- recent departure. The other was 
the state that was maximizing reduction of AFDC-U cases* 

In two other high performing programs, mechanisms existed within 
the WIN central office for participative decision making* These involved 
frequent meetings between the coordinators and their small central staff 
at which Ideas, proposals and problems were discussed openly prior to 
decisions. However, there was little evidence that field personnel were 
involved In state level deliberations. 



97 



113 



/ 



The remaining four states fell Into three different categories. 
In one self-contained, low performing program, decision-maKIng was central- 
ized In the state director, and little genuinfe consultation with subordi- 
nates was reported. This pattern was replicated at each level of the 
program hierarchy. In a second low performer, WIN was administered through 
the ES chain-o£-coramand down to the local office level, and declblon-maklng 
was controlled by the ES managers and supervisors rather than WIN personnel. 
In the last two (one low and one declining performer), decision-making 
was decentralized de fac to to local units. Passive top management In both 
programs neither enunciated policy nor created mechanisms through which 
subordinates could develop it. 



WIN Sponsor — Communication 



Wo analyzed "communication" in three different categories; 

• Downward — the transmittal of directives, guidance and 
technical assistance downward through the organization. 

• Upward — feedback upward through the organization as 
conveyed through automated systems and written and oral 
communications wliether formal or informal, voluntary 
or required. 

• Lateral — communication across units, especially con- 
tact between service deliverers working in different 
offices. • 

Respondents in only two states reported that downward communl- 
cation was a problem. Both were states where WIN sponsor staff received 
almost no formal training or technical assistance and where field visits 
were a formality. When the central office took some action or issued 
an Instruction, explanations were rarely provided. In both cases the 
attitude of the program director seemed a key factor. One Individual 
took a rigidly hierarchical view toward his subordinates. In our In- 
terview he expressed his belief that Information should be disseminated 
on a "need-to-know" basis only— and he would decide who needed to know. 
The other had long suffered the active hostility of her superiors and had 
adopted an entirely passive management style In the face of her problems. 

By contrast, several state coordinators paid special attention 
to downward communication. One state director described how he and his 
i-entral oft Ice staff reviewed federal guidance line by line, frequently 
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rewriting It out of a concern for how nuances of phraseology mi;.,ht be op- 
erational Ized In the lield. Field staff Inquiries were answered promptly » 
Staff were not only given answers but also taught how to think ab' prob-* 
lems themselves I so they could resolve them independently in the ret 
Training was extensive. Area administrators or "field specialists aw 
the provision of technical and programmatic assistance to service delivery 
staff as one of thel^f* main functions t 

Upward communication varied substantially across the sample* In 
five states (four high performers and the low performer with AFDC-U reduc** 
tion as its top priority) upward feedback of various types was most exten- 
sive* These were programs that generally had developed accurate automated 
reporting systems, permitted local supervisors to participate in planning^ 
and used site visit techniques that provided central office personnel 
with unfiltered feedback from service deliverers and line supervisors. 
In add it ion » three had weekly or monthly area-wide manager meetings or 
office visits by roving field specialists during which local personnel 
were encouraged to give their reactions to policies or problems and offer 
proposals. The state director and central ^office staff were accessible 
not Just to intermediate administrators but also to unit supervisors and 
sometimes line personnel. In most of these states, direct telephone con- 
versations between local and central of f ices on technical or policy issues 
were frequent . 

In the other programs, reporting systems tended to be less accu- 
rate, planning was generally downward, and field visiting was minimal or 
was structured so that only downward guidance occurred. Regular area- 
wide managers meetings did not take place, and direct contact between 
local and central office personnel was, with one exception, either minimal 
or formalistic. ' 

The reasons appeared to vary. In two states the program coordi- 
nator's disinterest in all but federally-*required reporting constrained 
other forms of feedback. According to subordinates, these directors 
wer^ uncomfortable with informality and insistent on adherence to hier- 
a^^chy and status. They tended to avoid situations that might lead to 
Confrontations or conflicts of ideas. All-staff meetings and other group 
sessions were usually either ceremonial or limited to the downward delivery 
of messages from superiors to subordinates. In two other states structural 
conditions (WIN was administered through the ES chain-of-command) filtered 
out or deterred feedback from the field to the central office. Finally, 
feedback efforts In several states seemed to be moderated by the culture 
of the SESA as a whole* which was hierarchical and directive. 

There are obvious obstacles to lateral communication among local 
units of a program which are dispersed across a state* Unless management 
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8tlmuUtefl contact among units. It is likely to be limited. However, 
in at least four states (three of them high performers) lateral commini- 
catlon was extensive. In these states it took various forms. Including: 

Regularly scheduled area-wide meetings of local unit " 
supervisors for problem-solving and planning. 

Annual state-wide all-staff conferences that were substan- 
tive rather than ceremonial. Service delivery personnel 
were not merely a passive audience for state or federal 
speakers but actively participated as panelists, instructors 
and workshop leaders. 

Training Involving personnel from different units struc- 
tured so that participants learned from the experiences and 
practices of others. 

.■» 

Staff (the "field specialists") whose functions included 
transmitting promising ideas or techniques from one unit 
to others. 

Informal contacts across local units based on past personal 
work relationships. ^ 

uDw.rd fiL-''^^!^''i communication pattern that includes considerable 

Zrlrt It ^^'^^"l ^°"tact among units, and direct, substantive 

may have favorable effects on WIN program performance. Some effects sug- 
gested by respondents were the following: eiieccs sug 

• Enthusiasm of service delivery staff, important in a 
program as difficult as WIN, was stimulated. WIN workers' 
increased sense of participation strengthened their feel- 
ing of responsibility for the program. 

• Top managers received feedback and ideas unfiltered 
by intervening administrative layers. This led to 
more rapid identification of problems or possibil- 
ities, which resulted in quicker adjustments to 
changing conditions and more experimentation with 
innovations . 

• Direct contact with top leadership enhanced service 
deliverers' understanding and tolerance of performance 
targets, regulations and other constraints that might 
have been regarded as oppressive or misguided. 
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• What Are the Characteristics of the Programme Staff? 

Afl already mentioned, the style of management in any organitatlon 

partly reflects the characteristics of the workforce — their background, 
expertise and attitudes* This section considers the following character- 
istics of WIN staff In our ten sample states: (1) demographics, (2) work 
backgrounds, (3) characteristics preferred by WIN supervisors, and (4) 
morale • It is important that this section be read with an understanding 
of the type of data on which It Is based • With minor exceptions, none 
of the data are derived either from documentary sources or from psycho- 
metrlcally designed surveys of a random sample of staff large enough to 
permit statistical inferences about staff In the ten state programs. The 
data are, instead, the perceptions of WIN sponsor, SAU, and other SESA 
and welfare agency personnel about WIN staff as revealed by semi-structured 
interviews with a non-random group of these respondents • As such, the 
Information presented here must be viewed as suggestive and interpreted 
with caution. 

Demographics 

In only three states were respondents able to differentiate WIN 
sponsor education levels from those of other ES staff. In all three they 
were seen as more highly educated. Nowhere were -WIN workers seen as less 
educated. The tendency of WIN sponsor staff to be percei/e^ In some 
places as more highly educated than the ES may have been due to the pro- 
gram's heavier mix of counselors. Many ES counselors transferred to 
WIN when the USKS de-eraphaslzed counseling In the early Seventies. In 
most places SAU staff were seen as having more education than WIN staff, 
primarily because many social services positions require master's degrees 
as a precondition for employment* 

WIN was also usually perceived as having more female and mi- 
nority staff than the mainstream ES. This was probably related to 
the past reluctance of some SESA's to employ women and minorities — 
especially for manager lal . posit Ions . According to our interviewees, 
career-minded women and minorities, sensing limited opportunities in the 
ES and UL\ tended to gravitate to WIN. Some were also attracted by the 
type of target population with which the program works, since it usually 
was more heavily minority and female than the clientele of the SESA^s 
other programs. As a result of these tendencies, WIN was generally seen 
as ^'better off in affirmative action than the SESA as a whole." In most 
places the SAU was perceived as being even more heavily female than WIN, 
presumably due to the easier entry of women Into social services than 
other professions . 
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Some exceptions to these generalities were apparent* In one 
state the WIN staff was predominantly male* In two western and one 
southern state there were many minorities in service delivery Jobs but ' 
few in management poaltlona. In a northeastern state the WIN director 
was black, but few other WIN staff were, although the state's largest city 
had a large minority population. Despite these exceptions, the perception 
that generally prevailed was of a program substantially staffed by women 
and minorities* 

Work Lackgrounds 

Interview data suggested a potentially significant difference 
between the work backgrounds of WIN staff in, high and low performers. 
Four of the low performers were staffed with 'individuals respondents 
characterized as •'finishing out their careers," or "ES cast-offs." These 
were not Individuals who had volunteered for WIN or had been selected 
by WIN managers. Rather they were personnel that WIN administrators 
often said had been "dumped" on them. On the other hand, the four 
high performers had been initially staffed primarily by the pick of ES 
workers, often personally selected by the managers for whom they were 
to work. In addition, many had worked in the agency a relatively short 
time, and, as one manager put it, "had not yet developed in-grained habits* 
Respondents in these four states tended to see WIN sponsor staff as more 
competent than their counterparts in the ES.* No similar pattern was 
discernible across the SAU's in part because SAU staffing in many states 
was done by county welfare departments and thus could vary from county 
to county within the same state. 

Why had the four high performing WIN programs been able to obtain 
more select staff? The reasons Included both SESA management attitudes 
and program structure. In three of the programs (all Integrated into 
the ES chaln-oE-comraand down to the ^ocal unit level) senior 'ES officials 



♦Studies conducted in California (1974-76) and Wisconsin (1975) 
examined the comparative "expertise" of different types of SESA staff 
using similar survey instruments. "Expertise" was measured in terms of 
training at job entry, continuous on-the-job training and formal edu- 
cation. In California, no substantial differences were found between 
FS and WIN staff expertise. In Wisconsin, WIN staff education levels 
and amount of Job entry training were somewhat higher than those of ES 
workers. Perhaps more interesting was the fact that, within WIN, staff 
In the high performing units scored higher in expertise than those in 
low performing units. See Van de Ven et al . (1976), p. 22, and-Roberts 
( 1 977 ), p. 45. 
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had given WIN hljjh priority and passed the word that WIN supervisors 
were free to takd their pick of existing staff or new hires* Xn the 
other (a self-contained program housed in a hostile SESA), the program's 

relative isolation from the rest of the SESA projected It until recently 
from interference in its personnel decisions • WIN management had been 
relatively free to hire whom it thought best for the program. 

Characteristics Preferred by WIN Managers ' 

The answers WIN supervisors gave to interview questions about 
the characteristics they looked for when hiring staff mirrored the char- 
acteristics WIN staff perceived -themselves to exhibit, WIN supervisors said 
they looked for individuals who were: 

• Interested^ in helping people; client-oriented; people- j 
oriented; counselor-types t 

• Open-minded; without negative attitudes toward the 
disadvantaged, minorities or welfare recipientSt 

• Enthusiastic and competent, since the program was 
difficult and complext 

e "Young blood"; short-term employees of the agency; 
staff that were less comfortable with routine* 

WIN supervisors' capacity to obtain such individuals, was, of course 
constrained by various factors. These included personnel, civil service 
and union policies and political interventions in hiring, as discussed in 
Chapter 3, 

Morale 

In our field research WIN supervisors and staff were asked ques- 
tions about morale in their unit and their state program* These questions 
touched on various aspects or indications of morale, including salary 
satisfaction, work satisfaction, perceived advancement opportunities, 
and staff turnover* A general pattern differentiated high from low . 
performing states* Of the four high performers, three had generally high 
morale » and in the fourth conditions were mixed — varying dramatically 
from place to place. In two of the low performers and the declining 
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performer, morale was generally low. In two other low performers. It 
was mixed.* 



Satisfaction with salaries was generally high among WIN staff in 
three out of the four high performing programs but only in two of the 
five low performers.** However, statistical analysis of data on average 
salary levels In 51 state WIN programs showed no significant correlation 
with performance measure outcomes. 

Some association between state program performance and "work" 
satisfaction was apparent. In three of the high performers, staff tended 
to say they liked their Job, their co-workers and the agency as a whole. 
In four of the low performers, dissatisfactions with each were frequently 
expressed. ^ 



Similarly, in the four. high performers WIN workers believed their 
advancement opport^wntties were good. In three of these states, WIN staff 
felt that the program was to some degree a training ground for ES managers 
and several ES administrators agreed. As one said, "if you can place 
welfare people, you can place anyone." The director of the fourth program 
had been able to create a career ladder within the program. In four of 
the low performers, chances of promotion for WIN staff were described 
as poor due In part to limited career ladders within the program and 
to difficulties in passing agency-wide promotional tests that were re- 
portedly oriented to personnel with ES or UC experience. 

Finally, supervisors and staff in all but three states reported 
that turnover was lower than in the ES. Each of these three was a low 
performer. 



*rn the Wisconsin organizational study, high performing WIN 
units scored better on "job satisfaction" than low performing units. 
However, when analyzed in combination with other variables, job satisfac- 
tion was not a significant explainer of WIN unit performance. In that ' 
study job satisfaction included survey items on satisfaction with the job 
itself, supervisors, pay, co-workers, and career advancement. See Van 
de Ven et al. (1976), p. 38. 

, ^ **A comparison with actual data on average salaries in these ten 
SKSA's provided an interesting validity check on our interview data. 
In each state where staff indicated satisfaction with their salaries, 
those salari^-s were, in fact, higher than average wages in manufactur- 
ing industries. And in each case where dissatisfaction was indicated, 
salaries were lower than those of manufacturing workers. 



104 




I 



5. Relations hips between WIN Sponsor and SAU Dlrectora 

The relationship between the two program leaders— the SAU and 

WIN sponsor directors— varied from close to hostile across our sample. 
The hostile or croubled relationships conformed to no particular pattern. 
One Involved an aggressive, entrepreneurial SAU director and a passive WIN 
sponsor director whose own supervisor was hostile to WIN. The SAU director 
felt that the WIN sponsor was incompetent, and he had actively sought to 
expand the SAU'a domain to cover direct placement. In a second state, the 
SAU administrator previ-jualy had had reaponslbilllty for Title V and a state- 
sponsored welfare-employment program, and he regarded them as superior to . 
WIN. Interorganizational Jealousy combined with hostility between middle 
level subordinates and personality differences to create a troubled relation- 
ship. A third case involved a domineering, autocratic WIN sponsor director 
with close ties to state politicians and an SAU director who had no support 
staff and limited status within her own organization. In each of these 
states, cooperation was good In at least some local offices, due largely to 
the efforts or friendships of individual supervisors or service deliverers 
(see Chapter 11) . 

In the states where top level relationships were closest, the 
program was characterized by: 

• Common WIN sponsor-SAU undertakings including joint 
training Sessions and staff meetings, joint field 
visits by the two directors, a common handbook, and, 
in some cases, a system of joint directives to field 
staff. 

• Oral rather than written forma of conflict resolution. 
The two leaders resolved differences by talking to each 
other rather than passing memoranda back and forth. 

• Frequent, Informal direct contact. These included weekly 
meetings, several phone por.versationa each day and, in 
one case, daily get-togethers over morning coffee. 

• Joint resolution of local operational or interpersonal 
problems whether the problem was ou the sponsor or SAU 
s Ide . 

• Evidence that both individuals put the interests of the 
program ahead of the interests of their own organization 
In carrying out such functions as annual planning and 
budgeting . 
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• Collaboration In managing relations with host organi- 
zations and with federal regional officials (one state). 
This Included jointly persuading superiors to fill posi- 
tions or improve facilities and orchestrating .regional 
office Intervention with host agency leaders on behalf 
of the program. 

The effect of central office collocation on these relationships 
was unclear. None of the three pairs who were mutually antagonistic were 
collocated. However, physical proximity seemed hardly likely to affect 
their deeply held differences— at least in the short term. Two of the 
9lx pairs whose interactions were classed as "close" were housed 
together. However, several of those who enjoyed good relationships but 
were not collocated made a strong case against requiring collocation. By 
being situated within their own agencies they felt they were better able 
to (l) monitor developments that might affect the progrera, (2) maintain 
their personal links and rapid access to superiors, (3) reinforce the 
idea that WIN was a joint responsibility rather than the u^her agency's 
domain and, (4) be more effective In facilitating action bv their own 
organization on behalf of the program. 

In all of the high performers these relations were close. In 
two of four low performers these relationships were hostile, but In the 
other two they were quite i lose In each of the latter cases, however, 
other organizational factors appeared to overpower any effect that close 
relations at the top might have had on operational realities (and produc- 
tivity) at the service delivery level. In one case, the diversion of WIN 
resources by the ES seemed the main factor. In the other the WIN sponsor 
and SAU coordinators, while friendly, were inactive in the face of re- 
source constraints and host organization Inattention or animosity. 

6* Host Influences on the Program 

The Influence of the host agency Is felt to varying degrees from 
the state coordinator down to the local WIN worker. Here we emphasize 
host Influence on the state coordinators and their central office staff. 
In all cases the host agency for the WIN sponsor central office was the 
SESA. However, in one of our study states, the entire program at the 
local level was run by the state welfare agency. 

Each host agency Is responsible for a number of programs. Each 
of these has its own set of goals, priorities and procedures. Since they 
are all affected by the policy and decisions of the host agency, each 
harf an Interest in Influencing those policies and decisions. The agency's 
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overall goals, priorities and decision-making processes presumably re- 
flect the comparative importance placed on the various programs by top 
managements 

A number of factors are at work within the host agency that de- 
termine the relative importance placed upon WIN and the bureaucratic 
environment within which the program operates. The host agency can cre- 
ate an environment that Is supportive, that imposes barriers, or that 
Is neutral toward WIN« 

WIN Sponsor 

Host agency factors influencing WIN programs are interactive in 
the sense that one factor influences another which, in turn, influences 
yet others. Thus, the overall goals and priorities of SESA's may be shaped 
by 'the interplay of a number of such factors. ,A SESA executive director, 
who is usually a political appointee, could interpret the agency's goals 
and priorities in light of the governor's political platform or could 
accept those advocated by upper-level career managers ♦ 

In the absence of pressure from the executive director, the SESA's 
career leadership could set agency priorities consistent with their past ^ 
program affiliations or the perceived impact of one program on others. 
They could attempt a "balancing act"— setting policies for the SESA that 
seek to maximize overall agency performance. No program would be empha- 
sized to the detriment of any other. This might mean that each program 
performance would be less than if its mission were paramount in the agency. 

The SESA's choice of goals and priorities will influence tasks. 
If the over-riding emphasis is on the employment service program, agency- 
wide priority will be on activities that result in increased numbers of 
placements and the maintenance of employer relations. SESA leadership 
might give low priority to decision^ relating to WIN, and those decisions 
might be evaluated predominantly in terms of their effect on the employment 
service. Other effects on tlje WIN central office could Include limitations 
on its decision-making power, delays in filling its vacancies, diversion 
of its resources to ES purposes and neglect of its computer work or train- 
ing needs. At the Local level, WIN could be limited in its use of job 
bank openings or denied access to ES job orders. WIN employer relation 
representatives could be prohibited, or they could be restricted to "sec- 
ondary" market employers.* 



*Such limitations at the local level will be treated in detail 
in Chapter 1 1 . 
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If, however, agency-wide goals and priorities are either neutral 
or supportive of WIN, the WIN sponsor coordinator and central office staff 
are more likely to have the authority and resources with which to Influance 
local operations and thus, performance levels. In short, they can determine 
their own fate. ' 

Table 16 presents data on the SESA's posture toward WIN in our 
ten study states. As the table Indicates, SESA posture toward the pro- 
gram showed no consistent relationship with state WIN performance. This 
lack of association la due Importantly to strategies followed by WIN sponsor 
^ coordinators and their central office staff, their effectiveness in Imple- 
menting these strategies, and their competence as managers. As the fol- 
lowing examples show, a WIN program can be consistently among the best 
performers In the country even though It operates within an extremely 
hostile bureaucratic environment. It can also help alter agency-wide 
goal definitions so that its comparative position In the agency improves. 

Success In a ho stile environment . One example was a program housed in a 
highly politicized, rigidly controlled and generally low performing" SESA. 
ES hostility to WIN was extensive, generally substantial. However, under 
the past aegis of an agei\cy deputy director the WIN sponsor coordinator 
had gradually transferred direct control of most local WIN units from the 

ES Nto his own staff. 

- . '■ * 

As various human resource development (HRD) programs were ter- 
minated in the SESA, the WIN coordinator was able to selectively recruit 
competent staff attracted by the program's able leadership, relative 
independence and more flexible style as well as Its purposes. Each time 
the state administration changed and some staff in other parts of the 
SESA were displaced for partisan purposes, WIN took the pick of them 
for Its own units. 

By continuing, strenuous efforts, the WIN coordinator was able 
to Insulate his staff from most Incursions by the politicians or the ES. 
Thus, this program had competent, well trained staff; accurate reporting; 
open communication patterns; sophisticated monitoring procedures; exten- 
sive downward delegation; and high performance — despite being located 
in a SESA that had none of these characteristics. WIN lived, however. 
In a siege atmosphere, never quite sure from where the next attack might 
come and whether the defenses could be maintained. 

Chanj^lng a SESA's priorities . In another state, WIN was run through 
the ES chain-of-command and had low priority with SESA leadership. As 
a result, the WIN coordinator had difficulty getting decisions from his 
superiors and cooperation from other bureaus In the SESA. He had few 
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Table 16 



SESA Posture Toward WTN 



SESA leadership perceives WIN as "important." 
Overall agency goals balance individual program 
goals. WIN central office has credibility with 
SESA leadership and considerable discretion. 

SESA leadership treats WIN equitably or is 
passive toward it. With "self-contained" struc- 
ture. WIN central office has direct influence 
over program policy and local operations. 

SESA leadership is passive toward WIN. However, 
program structure (welfare controls line author- 
ity over WIN local staff) limits the influence 
of the WIN central office. 

SESA leadership hostile to WIN or initiates 
policies that han^per WIN goal achievement. WIN x 
central office is still able to have some influ- 
ence over the program. 

SESA leadership hostile to WIN. ES priorities 
totally overshadow WIN. Limitations are placed 
on WIN operations; WIN goals are mostly dis- 
placed by ES ones; or ES controls all WIN 
local operations to their detriment. 



support 8taff of his ovm, and at the area and local level, ES personnel 
either diverted resources from WIN or ignored it. The program was a 
low performer, and federal reviews identified many problems resolvable ' 
only at the SESA level . * 

The state WIN and SAU coordinators worked closely together to 
alter the situation. The regional ETA administrator was persuaded to 
intervene. Not only did he make a strong case about the importance of 
WIN, but he also may have Implied possible funding cuts. The SESA commission 
chairman and the ES director then took a strong stand on behalf of WIN. 
The WIN director not only received easy access to his superiors and quick 
decisions on Issues he chose to put before them, but he Was also given "nego- 
tiating rights" to deal directly with other units, such as personnel 
and EDP, without going up and down the normal chains of command. On 
the advice of the regional office, a small but competent central office 
staff was developed, and a cadre of experienced, innovative field super- 
visors was installed. , 

Willie the program remained in an ES integrated command structure, 
most ES area and local office managers reflected the SESA leaders' view 
that WIN was "Iniportant ." They frequently assigned their best inter- 
viewers to the program and made ES counselors readily available to WIN 
clients. WIN staff were perceived not as outcasts but rather as likely 
candidates for promotion to ES management positions. Over the course 
of several years, the program moved from a low performer to one of the 
top five in the country. 

Important lessons can be learned from the above examples. When 
a state WIN program finds itself confronted with a hostile bureaucratic 
environment, its best strategy may be to gain line authority control over 
Its local WIN operations, capture needed staff and isolate them from SESA 
influence. On the other hand, if SESA leadership can be persuaded to be 
supportive or neutral, WIN line authority over local operations is not 
necessary to achieve relatively high performance levels. However, the 
WIN central office must maintain high visibility in the field, with direct. 
If sometimes Informal, communication channels- and program authority. 

Separate Administrative Units 

Relationships between the SAU coordinator and the state welfare 
leadership also impact on the WIN program. Just as in the SESA's, the 
attitudes of host agenry leaders towards WIN were reflected in their 
agency's goals and priorities. These attitudes, in turn, affected the 
posture the SAU took towards the WIN program or the emphasis that the 
welfare system placed on WIN. 
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The posture of state welfare officials toward WIN fell into three 
categories: 

i 

In four study states WIN had little or no support In 
the state welfare hierarchy* The sole social services 
priority was Title XX. 

In three states the state welfare department's 
posture toward WIN was based on the high priority It 
assigned to getting fathers ^ff of AFDCt 

In three other states the SAU had a moderate degree of support 
from the state welfare department, and WIN was considered 
an Integral part of welfare program policies. 

These priorities within the welfare department Influenced how 
effectively the SAU coordinators could carry out their functions. In 
the four states where WIN was given very little priority, the SAU was 
either completely separated from the rest of the welfare system (two 
cases); understaffed regardless of allocations available (one case); 
or not given any training, or technical assistance even on general social 
services subjects (three cases). In two of these cases, It was often 
Impossible for the SAU to obtain approval to travel to state or regional 
WIN meetings* 

In the second category, state welfare attitudes toward WIN centered 
on an agency-wide emphasis on keeping unemployed fathers off AFDC* This 
priority was reflected In the SAU's own priorities and led to rivalry 
between the WIN sponsor and the SAU over employment-related functions In 
two of these states. In one, the SAU had obtained an agreement from the 
sponsor that allowed SAU staff In the largest project to work Intensively 
with AFDC-U applicants before they were approved for welfare. This 
Included doing Job development, referral and placement. 

In the second state, the same bureau that operated the SAU also 
administered a placement program for recipients of general 'Assistance. ^ 



*There were welfare department placement programs for state gen- 
eral assistance recipients In several other sample states. They dealt 
with a population completely separate from the WIN target group and were 
concerned only with placing employables before approving them for general 
assistance. Two of the programs were operated through the same bureau 
administering the SAU, but were not related to or competitive with WIN. 
Only the program in the state described here resulted In competition 
between the SAU and WIN sponsor. 
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Until recently, that bureau also had administered a placement program 
for AFDC applicants. This program had been in direct competition with 
WIN and had been terminated after intervention by the WIN federal re- 
gional office; SAU managers and staff who had worked in that program 
wanted WIN eliminated and their own program reinstituted . 

In the third state in this group, the welfare department operated 
the entire WIN program on a subcontract basis from the S5SA. The SESA 
had never given WIN much priority and, according to several respondents, 
had been glad to give up responsibility for WIN. Thus, no competitive 
relationship existed between the two agencies. 

In the thr«e states where there was moderate priority given to 
the SAU's, the SAU and WIN coordinators had been able to develop extremely 
close and cooperative working relationships. Both the SESA and the welfare 
departments In these states had communicated to the field that WIN was 
to be given priority equal to other programs. Although WIN was not a top 
priority In any of these three welfare departments, the SAU coordinators 
were given total discretion In running their programs, had easy access 
to their superiors, and were given support and attention similar to other 
division heads In the department. 

These SAU leaders played a leadership role In the overall state 
WIN program. They coordinated with other state welfare divisions to 
improve state-county WIN relationships; participated In Improving joint 
IMU-SAU reporting systems; collaborated In joint WIN-SAU training and 
technical assistance In the field; and were free to promote priority for 
WIN in their own departments. One of these Individuals participated In 
planning a state workfare program that was to be coordinated, not compe- 
titive, with WIN. 

These three WIN programs were identified by our analysis as high 
performers. Their relatively high priority within both the SESA and the 
welfare department, plus good coordination between the WIN sponsor and 
SAU at the stace level, seemed contributing factors. 
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CHAPTER 7 
CONCLUSION 



In the preceding chapters we have described factors within state 
WIN programs hypothesized to Influence how they perceived their mission, 
how they were structured and how they made decisions on resource utiliza- 
tion* We have sought to identify (I) outside Influences on overall state 
WIN organization, (2) Interactions among hypothesized "major determinants" 
of organizational behavior, and (3) associations between these determinants 
and WIN performance. 

This chapter summarizes and synthesizes major findings In this 
part of the report. First It presents those characteristics consistently 
found In high performing programs but not In low performers. Then it 
considers what we have learned about relationships among "major determi- 
nants" and WIN performance. 

Characteristics Consistently Found in High Performers 

The following are the characteristics or arrangements that were 
systematically found in most high performing WIN programs and were gen-* 
erally absent in low performers: 

• WIN sponsor staff tended to have a clear perception 
of national program goals . There was a general 
consensus that quality of jobs was at least as 
important as the number of job entries. 

• SAU supervisors and staff saw their job not on]y 
as assisting the WIN sponsor by providing social 
services to registrants but also as creating 
coordinating linkages to the IMU and Title XX . 

• Goal dlaplacment by host agencies was non- 
existent or minimal. 

• Training of managers, supervisors and local 
staff was frequent and covered a relatively 
large number of WIN-specific areas. Much of 
this training was conducted Jointly for both 
SAU and WIN sponsor staff. 
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• There were relatively few problems with 

automated reportlrm aY***^**""*' Where problems 
existed, procedures were being followed that 
quickly resolved then. ESARS data were 
perceived as accurately reflecting activity 
levels. 

SAU and IMU repor ting svatemfl were generally 
accurate and problem-free. Procedures and 
linkages had been developed for accurate 
reporting on obtained employment and grant 
reductions. 

WIN sponsor and SAU central offices tended 
to undertake more intensive and sophisti- 
cated, mon itoring . This often included 
comprehensive and structured Joint visits 
to both SAU and WIN sponsor local units. 

WIN sponsor and SAU area staff or field 
supervisors had extensive WIN program 
experience and actively provided technical 
assistance to local WIN units. They also 
often acted as a communication link among 
local units and between local staff and " 
the WIN sponsor and SAU coordinators. 

WIN sponsor local units tended to have open 
upward communication linkages to the central 
office. Central office staff obtained in- 
formation on local program developments and 
problems through information systems, on- 
site monitoring visits, meetings with local 
staff, and frequent phone contacts with the 
field. 



WIN sponsor central offices promoted lateral 
communication among local staff through state- 
wide meetings, training sessions, or confer- 
ences. Some also used field supervisors to 
inform local offices about the experiences of 
other local units in developing more effective 
service techniques and resolving problems 
common to all offices. 
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• SAU programs tended to have credibility with / 
host agencies ^ WIN program goals were not / 
displaced « SAU coordinators were given / 

total discretion in running their programs, 
access to their superiors, and support and 
attention comparable to that of other 
programs in the host agency* 

2» Relationships among Major Determinants. Work Unit 
Characteristics and Performance 

Ficaire 9 presents graphically the interrelationships and causal 
Influences suggested by our findings. This figure is a more detailed 
version of Figure III. I, which appeared at the beginning of this part of 
the report. It shows lines of possible Influence among the major deter- 
minants and from these to local work unit characteristics. In addition, 
It depicts the strong qualitative associations observed between some or- 
ganizational factors and performance. These associations suggest that 
certain major determinants work through work unit characteristics to In- 
directly Influence WIN performance levels. 

Figure 9 indicates that some major determinants act upon eacft 
other. Thus, goals are shown as Influenced by organizational leadership, 
since host agency leaders and WIN coordinators may Impose their own Inter- 
pretations on national program policy. Goals, In turn, define the nature 
of tasks at all levels within the program. The overall structure of the 
program also may be Influenced by organizational leaders where their dis- 
cretionary authority permits. Leadership can affect staff characteristics 
too, especially, where external constraints (unions, civil service regula- 
tions and political patronage) are not dominant, and management can play 
a role In hiring and promoting program staff. 

Our findings also suggest that "major determinant" factors have 
a direct influence on local work unit characteristics. The nature of 
program tasks Importantly shapes how service delivery units conduct their 
work. Overall structure defines the bureaucratic environment within which 
local units must operate, for example, the length and complexity of com- 
munication channels. Staff characteristics define the composition and 
quality of the program's staff at the local level. Thus, vectors are 
drawn from these major determinants to work unit characteristics. 

Lastly, Fioure 9 Indicates that some factors appear to be as- 
sociated with program performance. That Is, changes In these factors 
would likely cause changes In program performance levels. Thus, we saw 
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Figure 9 

Relationships Between Major Determinants^ Work Unit 



Characteristics and Performance 



that state-^wlde WIN goals which conformed to national ones were consist- 
ently associated with relatively high performance^ Similarly, the way in . 
which coordinators and central office staff executed managerial, functions 
also exhibited a clear association with performance. However, these fac- 
tors are portrayed as having only Indirect Influences on performance* Any 
change In these factors would have to work first through local service de- 
" livery units In order to Impact on performance. Thus, the lines of Influ- 
ence from these major determinants — goals and organizational leadership— go 
through work Unit characteristics to performance. 

Fiauro 9 therefore Indicates some leverage points—parts of the 
state program on which federal and state WIN administrators might concen- 
trate efforts to Improve program performance." Strategies for doing this 
will be discussed In Part V. 



/ 

/ 
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PART IV 
LOCAL WIN DELIVERY SYSTEMS 



PART IV 
LOC;^L V^Ii^ DELIVERY SYSTEHS 



SUMMARY 

High performing local WIN units tended to differ systematically from 
toD performing units in the way they were managed and delivered services to 
^olients. WIN sponsor managers in high performing local programs tended to: 

0 Maintain more accurate and timely reporting 
systems^ 

0 Monitor or evaluate their operations more 
frequently and intensively. 

0 Emphasize systematic distribution of informa-- 
tiorn and more frequent internal discussion. 

0 Permit more flexibility regarding work rules 
and office procedures and delegate more ^ 
program authority to subordinates — but i^ 
combination with more highly developed 
acjountahility systems. 

0 Exchange functions among staff and cross- 
train tham for different jobs. 

0 Deal more directly and openly with conflict 
within the unit. 

Services to clients also tended to be delivered differently in high 
performing programs. In such programs: 

0 

0 '^cooperative clients were the subject of 
.re extensive counseling. 

0 Irparting job search skills to clients was 
enphasized. 

0 Job development efforts were focused on the 
individual client rather than just on 
jenerating a large pool of job orders. 
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• The SAU px*ovided extensive Qupi>ovtive 
servioea beyond ahild acwe, 

• More frequent and extensive interactions 
oaourred between SAU. and sponsor staff 
'Jhether or not they were oollooated. 



v.,.-7 ^"^"^X ^^^^/^f 3 "^ost significant points ia the pemeatinq 
tnjluence of state ,evet vaHables, Whether the issue was program priorities 
rnanager^ent be^navior or attitudes toward CETA, local oharacteristTas^mre 
extensyvely shaped by those at the state level. This suggests that federal 
ad^vmstrators need not reach down to the local level in order to hJve aT 
unpaot on .ocal operattons and performance. Rather, by influencing attitudes 
and practvaes cp/ program ard organization leaders at the state level, federal 
systems.^ '''''' ^''^ ^e/jaytcjr in a Uirge proportion of local service delivery 



systems. 

Other important findings were that: 

• '^^'T:^^'ES relations were not associated with 
WLV performance, 

• Wi:; staff put little reliance on ES job 
■jva^pis and Job banks, 

• WLV-IMU links were critical to WIN case 
management and reporting but were generally 
troubled, 

0 Higher performers tended to have more frequent 
contacts with IMU's, and a number of units 
had evolved strategies for improving the 
IMU linkage, 

• WIU access to CETA training and PSE jobs 
was jenerall'j limited ana was not associated 

t'fi pci'formance . 
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INTRODUCTION TO PART IV 



Part IV focu8ea on the work units that compose the local WIN 
service delivery system. The principal concern is the individual WIN 
sponsor units and SAU's that work with registrants at the community level. 
How do they Interpret their objectives and how are they structured and 
managed? Do they carry out program functions differently? What inter- 
actions occur within and between WIN sponsor units and SAU's? What links ' 
exist between WIN units and other programs or organizations which may be 
Important to the operation of WIN? 

As In Part III, we seek to identify variation and its causes. 
We want to see whether certain types of local unit characteristics seem 
Interrelated. Ultimately, we wish to learn whether there are patterns 
that systematically differentiate high from low performing local units. 
To do this, data on 43 local units in our ten study states were examined. 
Our sample included 10 high, 15 low and 18 average performers. Chapter 2 
and the Appendices explain how those units were selected, how adjustments 
were made for socio-economic differences in identifying high and low performing 
units, and how interview and survey data were collected and analyzed. Here 
we present the results of that analysis. 

As before, our presentation is framed around a general conceptual 
model of environment, organization and performance in programs such as 
WIN. The version of that model shown in Figure 10 highlights the work 
unit level constructs with which this part of the report is concerned. 
These constructs are influenced not only by local conditions and choices 
but also by the state level actions and policies examined in Part HI. 
Thus the influeiice of both local and state level variables on local WIN 
operations are discussed here. Chapter 8 begins with the interpretation 
of state program goals by local work unit managers and staff. Then it 
deals with unit size, collocation, and internal structure, constructs 
that fall under "Work Unit Organization." "Work Unit Management" is con- 
sidered in the next chapter. Chapter 10 focuses on local service delivery 
procedures, another dimension of "Work Unit Organization." 

Chapter 11 examines "Coordination and Communication Within and 
Among Work Units." This includes interactions within sponsor and SAU 
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Figure 10 
Work Unit Characteristics 



units and between them as veil as relationships between WIN and ES and 
IMU units— the host agency units presumed to be particularly important 
to the progi^am. Chapter 12 deals with moi^e distant relationships i ahown 
In the diagram under "InterorganiEational Coordination*" WIN unit con- 
nections to CETA prime sponsors, Title XX, Vocational Rehabilitation and 
other educational, training or community organizations are discussed there* 
As before, a ^concluding chapter considers our principal findings* ^ 

It is important to note that correlations reported In this part 
are meant only to suggest relationships that were identified by analysis 
of the qualitative interview data* In the correlation analysis, we used 
actual perfonnance scores for each local office, adjusted for environmental 
difficulty, as explained in Chapter 2 and Appendix B» For presentation 
purposes, however, the local programs have been labeled high, average, 
or low performers based on those actual scores* The correlations are 
reported because they present a clearer picture of relationships than 
would the tabulations alone* 
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CHAPTER 8 

LOCAL PROGRAM GOALS. PRIORITIES AND STRUCTURE 



This chapter deals with two basic characteristics of local WIN 
service delivery, systems — local perceptions of program goals and structural 
characteristics of local service units. Both goal perceptions and structure 
might affect local program performance — goal perceptions because they may 
suggest which functions and services are important, structure because it 
may shape the way specific tasks and interactions are performed. 

U Local Goals and Priorities 

The goals and priorities of a program are determined by its en- 
abling legislation and the interpretations of federal and state program 
administrators. It is usually not the prerogative of local managers or 
staff to set their own goals and priorities. Rather it is their responsi- 
bility to operat lonal Ize program goals that others have established by 
structuring their units, prioritizing among service components and allo- 
cating resources to achieve those goals. Local units have program goals 
as gi^ens; their unique contribution is translating policy into action. 



In this part of the report, we address the structural, procedural 
and managerial variables through which these goals are operat ionalized 
by local WIN units. Prior to proceeding, we must consider how they are 
perceived by local WIN sponsor and SAU staff. Was there a consensus on 
program goals and priorities among units in the same state? Did knowledge 
of the WIN Allocation Formula affect local unit perceptions of their goals? 
Were differences In goal perceptions associated with differences in per- 
formance? 

WIN Sponsor 

Goal consensus among local units . Most local WIN sponsor units visited 
had goals and priorities identical to those of the state WIN coordinator. 
Only eight of the 43 sample units differed from their coordinator in their 
perception of the WIN mission. Within each state program, the goals and 
priorities of the state program director had clearly shaped those of local 
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operations. a coYisequence . within the same state a high performlna 
local unit oU«n had the same goals and priorities as a low perforae?! 

'jjggalJLqowljed^e of the a 1 1 ocatio n_.fornu^ Staff in 13 of the 43 units 
had at least some knowledge of the allocation formula. Information on 
he fonnula had' been conveyed to • them with the explicit purpose of Improv- 
ing their understanding of program goals and the comparative Importance of 
W N performance measures, m one high performing state program, all units 

nnH ! '^"u''^^ ^^^^""^ summarizing the allocation process 

and torraula and emphasizing those performance measures with dollar pay- 
offs tor the state agency.* In two other state programs (one a high per- 
tormer and the other a low performer with a strategy for Improving Its 
per onnance). conferences were held to explain the formula and Its ke^ 
per ormance measures to local staff. Some other local WIN units received 
the r information on the formula and performance measures from visiting 
regional oft ice federal representatives. ^ 

n.. Kn^^^edge of the formula appeared to Influence the performance 

prlorlt es o local WIN operations. All local units that had been briefed 
on tlu. formula telt that the quality of their placements was at least as 
Important as the number of their Job entries. 

Infonr.lng local units about the formula and Its key performance 
measures wa« a very recent development. For some local units It resulted 

n a reversal of priorities. These had previously stressed "the numbers 
game -getting as many placements as possible regardless of expected dura- 
tion or salary level. Our performance data was based on the time period 
prior to th o. development. Thus, knowledge of the formula at the time 

our fio d work was not necessarily associated with the performance 
levels of local units as measured by our performance dat.a. 

kocLaljigxce]itions_,of priorities. Table 17 presents data on the perform- ' 
ance priorities of the 43 local units visited. A greater proportion of 
hiKh performers (eight of ten) had at least some staff concerned for the 
quality of job entries than did average performers (ten out of 18) or low 
perfornu.rs felght out of 15). However, the association between priorities 



*Thls WIN central office memo had been Intercepted by ES local 
ottlre managers In two of the offices visited. These ES managers opposed 
ttu. quallty-or-placement WIN objective, and local WIN staff were not In- 
tonnea about this objective. Both units were low performers. 



Table 17 

Local Unit Perceptions of Priorities 



High Average Low 

Performers Performers Performers Total 
General agreement that quality of 6 10 5 21 

Jobs was at least as important as 
quantity of Job entries* 

Some staff placed emphasis on - 2 3 5 

quality of jobs, others put 
priority on quantity of Job 
entries or some other measure* 

General agreement that number of 2 ' 8 7 17 
Job entries -was paramount^ . 

^ A3 



and performance level was not statistically significant It is not sur- 
prising that goal perception did not differentiate high and low performing 
local units » since both high and low performers In the same state were 
likely to have the same perception of program goals, as noted earlier • 

Local SAU Perceptions of Their Role in WIN 

More than half of the local SAU units visited thought their role 
In the WIN program was both to assist sponsor staff in moving registrants 
Into jobs and to act as a liaison to other programs. These units inter- 
preted jthelr objective not only as providing timely and quality social 
services, but also as linking WIN to other welfare units such as the IMU 
and Title XX. Most of these SAU's were actually fulfilling this r9le; 
others were frustrated in their attempts to do so»** 

Thirteen other SAU's saw themselves as playing a more limited 
role — predominantly paperwork and social service provision* They ex- 
pressed little concern about acting as intermediaries with other welfare 



^Correlation analysis showed a mild association between the two 
variables (r = .229) but a t-value that was less than the critical value 
for a .10 level of significance. Overall performance scores , rather than 
performance Rrouplngs (high, average, low), were used in correlations 
In Part TV. 

**See Chapters 10 and 11 for discussions of links to Title XX and 
IMU's , respec t Ively . 
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. Only two SAU s saw themselves as "competitors" to local WIN sponsor" 
... Perceiving local WIN units as ineffective, these units operated 
their own placement efforts for AFDC-U applicants and recipients. We 
found no association between the performance of local WIN programs and 
the perceived role of SAU's. 

2. Local Program Structure 

This section discusses the structural variations found in the 43 
local programs studied. It begins by examining the administrative arrange- 
ments made for WIN at the local level. Collocation of sponsor and SAU 
units is discussed next. A passage on local program size follows. Finally, 
we examine variations in the way service delivery responsibilities were 
Structured • 

Host Afi^encles 

for 1 .f'STM ''^^ considerable variance in the host agency arrangements 
for ocal WIN sponsor and SAU units. In one state the welfare department 
ran the entire WIN local delivery system, including both sponsor and SAU 
functions. This was reportedly the only state nation-wide where all local 
WIN programs were totally Integra ted-where a single manager supervised 
both sponsor and SAU staff. In the other nine states in our sample, local 
sponsor and SAU staff were under separate supervisors. 

WIN sponso r. Eighteen of our study units were ' integrated into the ES 
four were integrated into the welfare system, and 21 were self-contained 
WIN programs independent of ES line authority* Whether or not WIN was 

^""^^^^^^^^ into the local ES was not independently associ- 
ated with performance. In other words, high performing local WIN units 
were found both within and outside ES line authority. The same was true 
for low performers. 

However, as Table 18 shows, an intervening, third variable— 
the receptivity of SESA or local ES management to WIN-seemed to be an 
Important pre-condition for the effectiveness of line authority arrange- 
ments. In receptive settings WIN units that were within the ES line com- 
mand were either high or average performers. There were no low performers 
in such environments. WIN units in indifferent or non-supportive ES hier- 
archies fared much worse. Local units that reported to ES superiors in 
non-supportive ES settings were low performers. Where the ES chain of 
command was non-receptive, high and average performers were found only 
in separate, self-contained WIN structures. 



130 



J 



Table 18 / 

/ 

Local WIN Sponsor Line Authority Patterns by 
SESA Receptivity to WIN and Performance Levels 



SESA Supportive of WIN 



SESA Indifferent or 
Non-Receptive to WIN 



High Average Low 

Performing Performing Performing 
Offices Offices Offices 



High Average Low 

Performing Performing Performing 

Offices Offices Offices Total 



Integrated 
within ES 
structure 



/ ES manager has line 
authority over WIN, 

WIN manager reports to 
ES District/Area 
Director. 



2* 



1** 



13 



Self- 
contained 
WIN unit 



WIN manager has 
authority Independent 
of ES, not collocated 
with ES. . 

WIN supervisor, small 
unit, located in ES 
office, but independent 
of ES. 

Totals 



10 



13 



11 



16 



39*** 



"Aberrant case,. SESA Ladershlp waa not supportive of WIN but local ES Z^lTr's ware 
•••Total ..elude, th. four unit. fro. the .tat. «har. WIK loc.l d-llvar, ay'r:." ^plr^ted b, welfare. 



This Is further evidence that If WIN is within the ES line struc- 
In ll I ^'°rr Tc' ""^^'^ priority from the SESA 

thn^ttrr"'"^:;^' ^^^^ receptive, a separate line of au- 

thorlty from the state WIN office to local operations appears beat.* 

|M. As TablG 19- shows, SAU structures varied considerably among the 
tLlVri P"^'^^'"^ The structure of SAU's was more complicated 

than WIN sponsor units since state welfare systems varied more at the local 

with n'^he" ^'r' ''''' '^"'^ ^'^'y — seu!co^ta °ed 

within the state welfare department. In two of these states, local SAU 

th. r^?r^'^ r^'r ^^^P^^^^^^ ^ state-admimstered welfare system. In 

. r V . cmI^^'u "'^^^ ^^'^ county, welfare employees. These 14 self-- 

contained SAU's had only WIN responsibilities. 



Table 19 
Local SAU Host Agencies 



Number of local SAU's 



SAU Integrated into county social services ' 16 
structure within Title XX unit (super- 
visors, some staff have non-WiN respon- 
slblLltlea) . 

county } SAU Integrated into county Social services 7 
employ- ^ structure lateral to Title XX (super- 
visors, some staff have non-WIN respon- 
sibilities). 

SAU self-contained, but county (or city) 7 
welfare employees (work only on WIN). 



SAU 

•strite \ on 
emp 1 oy- 
et»s 



U self-cotKained, state employees (work 
ly on WIN.) 



7 



SAU Integrated Into state welfare, state 
employeos (supervisors, some staff have 
some non-WIN responsibilities). 



A3 



In Ch.ipttT 1 1 . 



*Tho Issue of local KS and WIN relationships Is treated further 
t-r 11, 
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sixteen of the SAU's studied were Integrated into county social 
services structures, reporting to a manager with Title XX responsibilities 
Supervisors and some staff had some non-WIN responsibilities i. especially 
in smaller counties. Seven other SAU^s were also Integrated into the 
county structure but were organizationally lateral to the Title XX unit. 
Again, supervisors and some staff often had non-WXN responsibilities. 
The other six SAU's were integrated into the state welfare system and 
were state employees # 

Whether or not the SAU's were self-contained or separate did not 
seera.to affect their ability to perform WIN functions. Instead, the pri- 
ority given WIN by the state or county welfare administration generally 
determined the types of relationships and Interactions that occurred be- 
tween the SAU and other programs, the degree to which SAU funds and staff 
were diverted, and how effectively the SAU could provide services. In 
welfare systems that gave priority to WIN, the fact that SAU staff had 
other program responsibilities did not appear to detrimentally affect 
WIN services. In some cases, SAU staff having other duties were more 
aware of the availability of other resources for their clients. But, as 
noted earlier. In state or county welfare systems with little emphasis 
on WIN, SAU funds and positions often went unauthorised or staff worked 
on other programs while charging their time to WIN. 

Collocation 

Collocation In the WIN program Is the physical location of WIN 
sponsor and SAU staff on the same premises. We found various degrees of 
collocation at the local level. Seven different categories were identi- 
fiable In our study sites: 

• Total separation of WIN sponsor and SAU. 

• "Part-time" collocation . SAU staff went to WIN 
sponsor office at scheduled times. 

• "Pa * tlal" collocation at V/IN sponsor office . One 
or more, but not all, SAU staff were permanently 
located in the WIN sponsor office. 

• "Partial" collocation at the SAU office . One or 
more, but not all, WIN sponsor staff were permanently 
located in the SAU office. 

• Total collocation In the sponsor or ES office . 
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• Total collocation I n the SAU or welfare office . 

• IMU staf f collocated with WIN sponsor and SAU 
In the sponsor or ES office. 

Defined in these terms, some type of collocation existed In all but 
four of the local programs we visited. However, as Table 20 shows, degree 
of collocation was not associated with high performance. Only three of thte 
ten high performing offices were totally collocated. 



Table 20 

Local WIN Sponsor-SAU Collocation 

High Average Low 

Performing Performing Performing 
Offices 



Offices 



Total st'po\rate WIN sponsor and 
SAtJ. 



0 



Offices Total 



"Part-time" or "partial" colloca- 
t ion. 



17 



Total WIN sponsor-SAU collocation. 
Total col location plus some IMU. 



8 
3 



5 
3 



14 
8 



43 



Degree of collocation seemed to depend on the size of the local 
prnyrrams. In smaller, less urban programs SAU staff' had scheduled times 
for being at the sponsor office to register, appraise, counsel or confer. 
rUe larger operatio^n.s were, more likely to have an SAU person or unit per- 
ma.u'utly located at the sponsor office or have sponj-or staff at the welfare 
ottlve to conduct registrations. The largest metropolitan programs studied 
w.Te totally collocated, regardless of performance level. Sponsor and SAU 
•^tatt occupied the same facility in all eight programs visited in urban 
areas with population above 350,000. Three also had IMU staff on the same 
premises.* 



*Wl\tM\ all WIN cases in an urban area are consolidated and handled 
the .-ollocated IMU, reporting and communications appear to Improve. 
In nio^t ot tlie WIN offices that had IMH staff, relationships between WIN 
md tint unit w.Te good, even though relationships with other IMU's In • 
r::.' . itv w.Tf troubled. Interactions and relationships between WIN and 
'M' ire lisc iissed In flhapter 11. 



1 



ERIC 



The degree of collocation did not seem to be associated with the 
type of relationship that existed between WIN sponsor and SAU staffs* 
Collocation in itself did not assure good relationships or coordination* 
There was some hostility, tension or work flow problems in six of the 
totally collocated unltst In some collocated offices the two staffs had 
very little to do with each othei:, or the two supervisors clashed fr * 
quently* Perhaps the most extreme case was a large metropolitan office 
In which unit supervisors from the '•two sides of the office'^ did not even 
recognize each other when called together to meet with researchers.* 

L ocal Projj^ram Size 

Size and p r oduct lvlty > The 43 local WIN programs studied varied widely • 
In size — from 200 registrants to 3K000* We visited local programs with 
one ES staff person assigned part-time to WIN and offices with 60 or 70 
WIN sponsor staff. The smallest SAU operations had one person covering 
several counties, the largest had over 30 authorized positions. 

Tell lo Jl presents Information on sponsor staffing levels for the 
43 study units. Twelve had five or fewer sponsor staff; ten had between 
five and ten Htaf,f; 13 had between ten and 20; and eight had over 20 staff* 
Staf.flng data for the 214 units In our ten sample states suggest that most 
..IN' staff work In relatively small units or o/flces. 

Over half the SAU's In our sample (24) consisted of less than 
three staff. Often these "units" Involved only one worker reporting to 
a supervisor wlio was 25 percent to '50 percent WIN-funded and who also 
supervised staff assigned to Title XX, day care, refugee programs or food 
stamps* , 

in Chapter 5 It was hypothesized that program size might affect 
performance. However, no significant relationship was found between state 
program sl^e and performance. Statistical analysis of local ^program size 
and performance was conducted using data on 154 local programs from nine 
of our ten sample states. It yielded similar results. We found no sig- 
nlflrant relationship between program size (number of registrants) and 
productivity (Job tMitrles per staff). 

f f ill^. Jl\ L^lMl Lll. and Productiv ity 

Statflnw; inti»nslty varied enormously across the 214 local pro- 
grams In the ten -sample states. At one extreme was a site with 1.21 
paia sponsor positions for each 100 registrants. At the other was a pro- 
>;ram with onlv .)i i)OsUlons per 100 registrants. The average was -.35. 

*K^»r rurt!u»r dlsousslon of WIN sponsor-SAU Interactions, see 
(*hapt i-r I 1 • 
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Table 21 

Local WIN Sponsor Staffing Levels 
and Organization Structure 



High 



Average 



• •'•B" rtvciage Low 

Performing Performing Performing 

Offices Offices Offices Total 



Integrated into ES Structure 

.5 to 5.0 sponsor staff 
5.1 to 10.0 sponsor staff 
10. I to 20.0 sponsor staff 
Oyer 20.0 sponsor staff 

Intetirated Into Welfare Structure 
.5 to 5.0 sponsor staff 
5.1 to 10.0 sponsor staff 
10. I to 20.0 sponsor staff 
Over 20.0 sponsor staff 

Sepa rate Self-contained WIN Programs 
.5 to 5.0 sponsor staff 
5.1 to 10.0 sponsor staff 
10. 1 to 20.0 sponsor staff 
Over 20.0 sponsor staff 



3 
1 
I 
I 



0 



1 
I 

2 
1 



0 
0 
1 
0 



3 
2 
4 
3 



2 
3 
0 



6 
5 
3 
4 



18 

2 

0 
2 
0 



4 
5 
8 
4 
21 



Chapter 5 noted a strong statistical association between state 
sponsor staffing intensity and the proportion of registrants obtaining 
jobs'. The same pattern appeared at the local level, although somewl>at 
loss strongly. Analysis revealed a significant positive correlation 
(r = .39) between local staffing intensity (staff /registrant ratio) and 
the proportion of registrants entering Jobs. 

The analysis considered all local programs in our ten state sample. 
Two factv)rs— state level staffing/registrant ratios and program size— 
ovtdentaLly confounded the analysis, resulting in a lower correlation co- 
efficient than had been found in the state level analysis. First, there 
were significant differences in staffing intensity among state programs. 
Local staffing levels are based on the total number of positions authorized 
to the state. Thus, in states with high staff /registrant ratios, local 
programs also had high staffing ratios. When examining the relationship 
between staffing intensity and proportion of registrants entering employ- 
mont, local programs tended to cluster together by state, thus lowering 
t^'*' !i^era_lj_ correlation based on local units across states. 
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The lower" correlation coefficient, therefore, does not mean that 
the relationship was weaker at the local level than at the state level. 
In fact, further analysis revealed that the correlation between staffing 
intensity and proportion of registrants entering employment was as strong, 
and often stronger, within each of the states studied than among the ten 
states.* Therefore, within a given state, local programs with relatively 
higher staff /registrant ratios had a higher proportion of registrants 
entering employment. 

The second Important factor In analyzing staffing Intensity was 
program size. Within any state, large metropolitan operations generally 
had the lowest staf f /registrant ratios and the lowest proportion of regis- 
trants entering employment. In order to examine the urban operations more 
closely, correlation analysis was. conducted across all the large programs 
(those 24 sites with more than 4,000 registrants) in the states studied. 
'A significant correlation of .64 was found between staffing Intensity and 
•entered employment for these urban offices. This indicates that metro 
operations with relatively high staf f /registrant ratios are likely to 
have a greater proportion of their registrants enter employment than other 
metro sites with a lower staffing Intensity.** 

Higher staffing Intensity probably means more time can be spent 
on reporting and on serving clients (both active and unasslgned recipients) 
and, thus, Improving productivity. This sugge§.ts that local program suc- 
cess Is susceptible, at least In part, to direct managerial Influence. A 
Htate or federal decision-maker can choose to target more sponsor staff 
on a particular site (or type of site) with some degree of confidence that 
Increasing staff Intensity will result In a greater proportion of regis- 
trants In the targeted slte(s) entering empi .yment. 

SAU/Sponsor Staffing Ratios 

There was also wide variation among local programs in the ratio 
of SAU staff to WIN sponsor staff.. On average, the 43 local programs 
studied had one SAU staff for every 2.4 sponsor staff. But these ratios 
ranged from one SAU staff for every II sponsor staff, to three SAU staff 



*Withln the six states with more than ten local WIN programs, 
correlations between staffing intensity and proportion of registrants 
entering employment were: .34, .59, .61, .70, .66 and .29* 

**Four of the largest metro offices visited were operating with 
several staff vacancies (one had 14 vacant slots). These four normally 
had very low staf f /registrant ratios anyway, and the added burden of 
vacancies sometimes meant staff were hard-pressed to register clients 
and do papt^rwork and had less time to spend with each registrant. 
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for every one sponsor scaff. In one of the ten study states, there were 
50 percent more local SAU staff thah local sponsor staff. In another. 
SAU/sponsor staff ratios varied Immenssly from site to site (from 1:1 .79 
In two sites to 1:11.0 In two others). Analysis of data from the 43 study 
sites revealed no significant association between SAU/sponsor staffing 
ratios and overall performance » 

Structure of Service Delivery 

Local service delive ry approach . As Table 22 Indicates, service delivery 
responsibilities were structured four different ways In our study sites. 
The approach used depended In part on the size of the program, the prefer- 
ence of state WIN officials and the relative priority placed on various 
procedures. No association was observed between performance and service 
delivery approach, perhaps because there was so little variation across 
the study sites. 



Table 22 " 

Local WIN Sponsor Service Delivery Approach 



1. Informal structure (small programs) 

2. Team approach, with case responsible 
person 

3. Caseload approach 

4. Functional approach 

43 



High Average 

3 3 

1 1 

2 1 

4 13 



Low Total 
3 9 

0 2 

V* 

1 4 
11 28 



In programs with three staff or less, an Informal structure was 
the norm. Each worker performed basically the same tasks, eveh though 
one might be Identified as the "team leader," or "supervisor." 

Most larger sites (28) followed a functional approach. The office 
was subdivided according to procedures, usually Into three types of units: 
intake (registration and appraisal), job preparation, and employment serv- 
ices counseling. Job development, placement). The procedures and staffing 
of each unit varied among the sites, reflecting the priorities placed on 
the different functions. Within each unit, Individual staff often had 
responsibility for a particular set of clients. 
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In four sites (all with about ten sponsor staff) services were 
delivered on a caseload basis. A client was assigned to an individual 
staff member who delivered or coordinated all sponsor services to that 
client— from appraisal to placement and follow-up. 

* a 

In the two sites which followed a team approach , an interviewer, 
counselor and Job developer usually worked together to provide all serv- 
ices to a client. One person was designated as team leader. Each member 
of the team was assigned main responsibility for different clients as 
they entered the program, thus combining aspects of the caseload approach 
with the team model. While SAU staff were not formally team members, . 
they were Included In many case decisions, v. \ 

In six of the ten study states, the WIN central office staff had 
clearly Influenced the local service approach, in five of the six, state 
WIN and SESA officials had developed standard structures, and all sites 
within a state were very similar. In the sixth state, central office staff 
had consciously delegated decisions on this issue to local WIN managers. 
A variety of approaches were adopted throughout the state, and managers 
reported experimenting with different structures over the years. 
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CHAPTER 9 
LOCAL PROGRAfl tIANAGEMENJ 



.. The way In which local WIN managers manage may have an important 
Influence on the performance of their units. The first section of this 
chapter describes the different w&ys in which managers conduct specific 
administrative functions in the 43 units studied. 

A second section then discusses other aspects of local managers' 
behavior In these units: How much do local managers differ in delegating 
authority to staff? How flexible are they in interpreting regulations and 
procedures? Are they open to innovative changes? How much Information do 
they communicate to staff? Do they encourage feedback and staff participa- 
tion In problem-solving? Both sections of, the chapter focus particularly 
on those management characteristics associated with differences in local 
program performance. 

I 

1 • Local Management Functions I 

• ^ 

Chapter 6 showed that state program coordinators varied in the 
way they conducted managerial functions (i.e. planning, budgeting, training, 
reporting and monitoring) and that these variations were associated with 
state level program performance.* High performing state operations tended 
to execute each of these functions one way, low performers in a distinctively 
different way. High performers con^sistently placed more explicit policy 
emphasis on and committed more staff and capital to these activities. 
The reverse was generally the case for low performers. 

This section looks at data gathered on similar functions in the 
43 local units. Analysis of these data was complicated by state program 
Influences on local management behavior. Local operations are not entities 
unto themselves. While they have varying degrees of discretion in managing 
their resources and providing services, they are at the same time subject 
to Influence by state policy, directives and suggestions. State influences 
can either limit or enhance the execution of local managerial functions. 
Thus, In states where the WIN coordinators actively and frequently monitor 
local programs and expect local managers to do the same, local managers 
are likely to emulate their bosses. Where little is done in monitoring at 
the state level, similar behavior might be demonstrated by local managers. 
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Local units are also subject to- statewide conditions that are 
beyond their control. For example, maintaining accurate local data 
reporting is a much more difficult task in states where the ADP operation 
is in disarray, WIN has no computer specialists to help correct the 
situation, and reporting system training for local staff is non-existent • 

Because of the potential significance of state level influences, 
we have analyzed information on local management functions in two steps* 
First, the Information was tabulated for all 43 units and analyzed. Second, 
It was retabulated into two general ^categories representing the states' 
posture toward the function in question and reexamined* For example, when 
looking. at the data reporting responsibility of local managers, local units 
were divided into two groups — those in states with relatively accurate or 
improving systems and those In states where data was Inaccurate and 
unimproved. Patterns within these two groups were then studied* 

The following subsections deal with four areas of local managerial 
responsibility; (I) planning, (2) training., (3) data reporting, and 
(4) monitoring and evaluation. 

Planning 

Local involvement in state WIN plan development has been a WIN 
priority since mld-1977. WIN field memoranda refer to such local partici- 
pation ^s "bottoms-up planning." In recent years these memoranda have 
specified that activity objectives developed by local units should be at 
least equal to their actual achievements during the prior fiscal year* 
The WIN manual also stipulates that local managers should use the planning 
process to set realistic targets for staff, to allocate resources among 
activities, and to identify areas where local programs could improve* 

However, our field work showed that actual planning in state and 
local operations did not often reflect these policies. Some state programs 
had bottoms-up planning in some form, while others did not* Those states 
with local participation in plan development varied in how they interpreted 
the "bottoms-up" process. Some actually yent through a cycle during which 
local units submitted estimates and negotiated with central office staff on 
final unit '"goals." Elsewhere this process began but was disrupted by 
external events. In some Instances the regional office increased the stater's 
Initial activity objectives, causing a unilateral increase in all local goals. 
In other cases time simply proved too short for completion of the full cycle, 
resulting in the unilateral assignment of final goals to units. Such 
developments led to a loss of credibility for planning by local staff. 
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In yet other states, the central offices gave local units their numerical 
objectives and told them to build a local plan»around them* Thus, state 
decisions on how planning would occur and to what extent Ideals would be 
Involved clearly influenced local planning activities and perceptions of 
its worth • 

During our field visits to local units we obtained a description 
from managers and staff on how planning had occurred in past years and during 
the most recent planning cycle. This information is used in the following 
paragraphs to describe (1) th? incidence and nature of joint SAU/WIN sponsor 
planning, (2) the attitudes -aipd behavior of local office managers toward 
planning, (3) the amount of local sponsor staff Involvement in plan develop- 
ment, and (4) the extent. of local SAU part Icipat Ion in the development of 
the state SAU plan. ' ^ 

Joint SAIJ/WIN sponsor planning . Relatively few units visited (one out of 
five) jointly developed a local WIN plan. Most (53 percent) had just one 
meeting to discuss separately prepared plans. There was no contact on local 
plans between SAU and WIN sponsor units in seven of the 43 communities visited. 
However, In states where the WIN central offices emphasized planning and local 
Involvement, a greater proportion of local units had joint planning sessions 
(33 percent) than in states with little or no emphasis on planning (17 percent). 
There was no discernible relationship between incidence of joint planning 
and local unit performance levels. Joint planning was just as likely to 
occur In low performing units as in high performing ones. 

Local managers and planning . Nearly half of the managers in units studied 
(44 percent) treated the planning process seriously, either because state 
policy '^required local input to state plan development or because they 
themselves placed importance on planning. However, local managers Ip states 
emphasizing planning were more likely to do more than the minimum required 
(67 percent of units studied in these states) than those in states where 
planning was not emphasized (28 percent). 

A bifurcation was also observed when the relationship between unit 
performance and the degree of managers' Involvement in planning was examined. 
In states emphasizing planning, managers of high performing units were more 
likely ro take planning seriously than were those of low performers.* Such 
a pattern did not hold for local unit managers in states where planning did 
not receive much priority. 



*Wlien the extent of manager Involvement and interest in planning 
was simUuI and related to unit performance levels, a correlation coefficient 
of .4^^^ resulted, significant at the .1 level. 
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Lo cal staff Involvement In planni ng. Less than a third of the local offices 
studied (13 of, 43) Involved staff in local plan development. As with local 
office managers, th^ Incld^ce of staff involvement in plan development was 
h^her In states emphasizing planning (44 percent of the units studied) than 
in\those without such state level priorities (one out of five offices studied 
m those states). The extent of staff invplvemgnt in plan development was 
positl\^ely related to unit performance (r-'.645) in states emphasizing 
planning". High performers tended to have staff involvement in the planning 
process while low performers did not. No such association was found for 
units, studied In states not giving priority to planning. 

Local SAU Involvem ent In state plan development . Only 12 of the 43 local 
SAU units studied (28 percent) provided some staff Input to state plan 
development or were asked to review and comment on the plan prior to its 
f Inalizatlon. Over a third of the SAU units (16 of 43) had absolutely no 
Involvement in the planning* Many of these were not even aware that such 
•a plan existed . . . • ' 

I 

Training j 

Local WIN sponsoi/ and SAU staff can obtain program-related train- 
ing from a number of sou/rces. State SAU and WIN sponsor central offices 
may provide formal trali^lng to these units either directly or through area 
offices. Host agencies/ may provide general training related to their over- 
all agency mission. Tl/ese agencies may control all training authority and 
resources, as was the k&Be In two states visited. Thus, a SESA training 
unit might be charged/with providing WlN-speclflc training, and decisions 
on curriculum development and assessment of training needs would be beyond 
the control of WIN central office staff. 

Criteria for making formal training available to staff also varied 
among states. Staff training, where available, could be mandatory or 
provided upon request. Therefore, local managers might either have little 
discretion or be able to use their judgment In requesting specific training 
for particular staff. Local managers could choose to augment this training 
or could provide staff with Informal training themselves in states where 
little or no formal training occurred. In many local WIN sponsor operations 
visited (21 of the 43) the only training local staff had received during the 
prior 12 months was on-the-job training and self-instruction on the WIN 
manual. In seven of these operations staff felt that even the OJT provided 
had been Inadequate. 

Analysis of data on formal training of local WIN sponsor staff 
indicated that local managers tended to have little Influence on the amount 



♦Significant at the .01 level. 
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and type of training provided their staffs If they were In states empha- 
sizing training, staff received extensive training (85 percent of units 
visited In these states) • Conversely » staff In only three of the 23 units 
In states where training was not given priority had received at least 
some WIN-speclflc training* Given this dominant state level Influence, 
there was no discernible relationship between the extent of local staff 
access to formal training and local unit performance* 

However, local managers could still provide Informal training In 
the absence of state-provided training or to supplement existing formal 
training* Most units studied In states with extensive training (86 percent) 
had local managers that also provided at least some Informal training to 
staff* This was the case for a few units (26 percent) In states where 
formal training was minimal or non-existent • The extent of Informal training 
provlded^staf £ by managers was positively related to local unit performance 
(r«v479) for units In states emphasizing training. Such an association 
was not found In loca^l WIN Sponsor units in states not giving priority 
to training • 

Local SAC staff access to WIN-speclflc ..training was closely linked 
to the amount of joint SAU and WIN training that occurred at the local 
level* At least one joint training session had occurred in 80 percent 
of the units visited In states emphasizing training • Joint training was 
quite rare in states with little priority on training, with only 17 percent 
of the units studied In these states reporting such sessions. As a conse- 
quence, local SAU staff. were more likely to receive at least some WIN 
training In .states where the training of sponsor staff was extensive than 
they were In states where such training was rare* The only exception to 
this pattern' was one state where the SAU coordinator provided frequent 
and extensive training to " local staff, but sponsor staff received no WIN- 
spec If Ic training* 

Data Report Inj^ 

Local managers have responsibility for reporting their units' 
activity levels. They provide Inputs to ESARS, CAS and other SECA reporting 
systems, and local IMU units report welfare grant reductions ana ''obtained 
employment" data. These data may be used to manage local operations as well 
as to hold managers accountable at higher levels within the system* Thus, 
the quality of input data maintained by local managers has Implications for 
their own and state-level monitoring and accountability systems. Since these 
data can provide the basis for performance assessment, how well they capture 
actual activity levels may affect percept Ions ^of local unit effectiveness* 
Report In)^ well or badly could spell the difference between a "high" 
perrormlng operation and one with a much lower perceived performance level. 

*S l;i;;nl f leant at the *05 level. 



Aa with plahnlng and training, state level policy and behavior had 
a algnlf leant Influence on how local WIN sponsor managers dealt with reporting 
and data systems. Only two local units of the 20 studied In state programs 
with serious ESARS problems felt that ESARS printouts generally agreed with' 
their locally-maintained h^nd tallies. In states where ESARS were generally 
accurate, nearly three quarters (74 percent) of the units visited felt that 
their data were accurate. Across both sets of states, there were 15 local 
units where ESARS was viewed as. a "hopeless" case. Most of these units (12) 
•were tn states where there were serious accuracy problems In ESARS state-wide. 
Six of these units (all low performers) did not even maintain a hand tally 
system either to manage with or as a means of identifying where the data 
problems were. . 

A significant positive relationship existed between the extent of 
local problems with ^,SARS and unit performance. This held for all 43 units 
studied (r=.306*) as well as for those In states wlt.h relatively accurate 
ESARS data "(r=.400*) and those In states where problems were rife (r=.410*'). 
Were some units "high" performers simply because they captured data more 
accurately on key performance Indicators, or was accurate reporting part of 
a cluster of characteristics that caused services to be delivered to clients 
more effectively? We cannot be sure, but If part of a local operation's 
responsibility Is to accurately report their activity levels, then failure 
to do so is, in fact, poor performance of an Important program function. 

Local IMU reporting for the WIN program was a critical problem In 
seven of the .43 localit les studied. It Involved major undercountlng on both 
welfare granf reductions and "obtained employment." No Improvement or effort 
to improve was evident. In another nine units some undercountlng was occurring, 
combined with significant time lags on reporting data, with no apparent 
improvement. In the remaining units, either accuracy and timeliness problems 
were minimal (20 units) or significant Improvements In reporting had occurred 
due to local initiatives by the WIN sponsor, the SAU or both (7 units). 
Local units tn states, that generally had accurate ESARS data tended to have 
fewer problems with IMU reporting. Local programs that made an effective 
effort to keep their ESARS data clean also actively sought to Improve IMU 
data through frequent personal contacts between supervisors or staff, joint 
training sessions or presentations on WIN. Those not giving much priority 
to improving ESARS data accuracy tended to have the same attitude toward 
the IMU data. There was no perceivable relationship between the accuracy 
of local LMi; data and local WIN unit performance. 



*Slgn If leant at the .05 level. 
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Monitoring and Evaluation 

./ 

The three management functions that \\ave already been discussed^** 
local planning, provision of staff training and data reporting—may have 
a combined Influence on the monitoring and evaluation activities of local 
managers. When local planning generates realistic activity level objec- 
tives for the unit and staff are involved in the planning process^ account- 
ability may be enhanced* Staff should know* what is expected of them, since 
they contributed to the expectations* Provision of staff training on form 
completion, data input ing and error corrections should improve the accuracy 
of the data upon which the office is managed* How these data are used in 
identifying problems and developing ways of resolving them depends in 
part on the training local managers and supervisors have received* The 
subsections which follow address the extent, basis and character of local 
program monitoring. 

Extent o f monitoring by local managers . All high performing local units 
studied had office managers or supervisors who monitored on an on-going 
basis. This was less prevalent among average performers, occurring in 
two-thirds, and was the case in only a third of the low performing offices* 
In 15 of the 43 units studied, there was little or no use of data by managers 
in monitoring their local programs* The prevailing attitude in these units 
was that upper management did such monitoring and if there were problems 
with the unit's performance they would be brought to the attention of the 
local manager* (Unfortunately, most of these units were in state programs 
where state WIN coordinators had similar attitudes and very little monitoring 
of local units was occurring*) 

The frequency and degree to which local managers monitored their 
operations was correlated positively to local unit performance (r«*524)** 
The more extensive and frequent the monitoring of the local manager, the 
higher was the performance of the unit* State policy and practices on 
program monitoring did not appear to have a dominant influence over local 
behavior. However » the relationship between the monitoring practices of 
local managers and unit performance was somewhat stronger in units where 
the state central office also emphasized monitoring (r»*682)* than elsewhere 
(r=.486)**. 

Types of performance standards used in mointorlng . Local office managers 
took a number of approaches to monitoring* One involved primarily looking 
at unit or offlce-wtd^ activity and performance levels* In some of these 
sites expectations on performance were based on what managers felt was an 
acceptable level of activity given local labor market conditions, the flow 
of clients, the characteristics of the existing pool of registrants and other 



*Sl)4nif i r.mt at the ,01 level. 
**Sl>^ni f leant at the .05 level. 
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factors beyond the control of staff. Monitoring was baaed strictly on how 
well the office was achieving its planned goals 0!;i^ certain . key Indicators. 
A second approach involved monitoring the performance of individual workers 
and reviewiiig their productivity relative to expected levels of performance. 

Analysis of these data showed that those units where office-wide or 
unit goals were used tended to perform better than ones with goals or quotas 
for Individual workers. Managers in most of the high performing units (70 
percent) monitored primarily on the basis of unit or office-wide performance 
However, most of these managers also maintained data on Individual workers. 
This permitted them to diagnose possible sources of problems when and If 
they arose. Two of the remaining three high performers primarily monitored 
individual workers. These were small units where quotas were not co.nstant 
across workers but were tailored to the skills, experience and caseloads 
of the service providers. 

Few of the average performers (28 percent) or low performers (20 
percent) monitored only on the basis of unit or office-wide performance. 
Over half of the average performing units had set Identical quotas for' 
Individual workers regardless of their experience or caseload responsi- 
bilities, or did little or no monitoring. of any kind. The same was true 
for low petformers (73 percent). 

Basis for. monitoring. Chapter 6 discussed activity goals , developed during 
the planning process and their uie In monitoring local programs. Some local 
.operations appeared to have unreallstlcally low planning goals which were 
easily attained during the course of the year. As a consequence, it was 
not unusual to come across units that were "achieving 150 percent of thelt 
go&l levels" on certain key performance Indicators. In other cases, local 
units complained about unreallstlcally high goals. Often this perception 
of staff was supported by our own stati/stlcal analysis of environment and 
performance. If either under- or over-estimation of unit capabilities 
occurred, the operation could suffer. Units that "low-balled" on planning 
objectives xnlg^.t tend to relax their effort once these goals had been 
attained. Units with goals that were consistently too high might become 
discouraged. Beth sets of responses could result In staff working below 
their potential. 

Half ci the units studied in states where the WIN central office 
stressed monitoring felt that their goals were set at realistic levels. 
This same perception was held by a third of the units In states not em.iha- 
slzlng monitoring. Analysis showed a significant "positive correlation' 
between staff perceptions of how realistic activity goals used In monitoring 
wort' and local unit performance (r=.559*). As goals used In monitoring 



*SlKiilt leant at the .01 level. 
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became either t<>o low or too high relative to perceived unit potential, the 
performance of units decreased. 

Kxtent ot loc al SAU" monitor ing eff ort. As stated In previous chapters, 
there are no generally accepted formal performance measures for SAU unltst 
Also, the extent and nature of qualitative Information provided by local 
SAU units varied from state to state and, In states with county-operated 
welfare systems, from county to county. Despite these limitations, our 
field whrk suggested that local SAU supervisors were more likely to monitor 
and evaluate their staff periodically than were sponsor supervisors. Less *• 
than 10 percent of SAU units studied had little or no supervisor monitoring, 
compared tt) over a third of the sponsor units. 

Only nine of the local SAU units studied had participated In a joint 
review vif their local operations with WIN sponsor staff. In seven of these 
sites .there was a formal policy of regularly scheduled joint reviews. 
However, joint ^Al.7WIN sponsor reviews of local operations were just as 
llk*»ly to occur In hi.^h performing local programs as In low performing ones. 

2. Local Management Style 

.\naIysi^i of WIN local management style is complicated by the fact 
that the program takes various organizational structures at the local level. 
The WIN sponsor "manager" might be the WIN office manager in a WIN-dnly 
i>itli'e hut mli;ht also be an ES local office manager, an ES placement super- 
visor, or even a welfare office manager. Four elements of local managers' 
^.tyle were analysed, regardless of their job title: 

• Flexibility and delegation of authority. 

• Innovat Iveness « 

• Co:nmun ic at ion. 

• Interpersonal interaction with staff. 



This siM'tivMi presents the results oZ that analysis, first focusing on WIN 
sponsor !nanav;ers and then SAU's. 

WIN Sj>vM\s-^r 

M.ina^erial t 1 ex 1 h t 1 1 1 y and dol egat io n of authority . WIN units have many 
5^r«^.'t»dur es and lunetlons that are standardized. State regulations govern 
the* -n .iti.i>;t*in(.'iit i^t persi)nnpl , ecjulpnient and office space* Federal regula— 
t i >;v; -it i iMi ; K f wrvici' dclivt.-ry procedures and paperwork. However speci- 
t( • rh.";»- r>'t'.iil,it liniH , managers still have room for Interpretation and 
t h x i 1 1 1 V . ' 



Analysts showed a positive association between performance and 
managerial flexibility.* Managers of high performing units were often as 
Hexlble as state policy would allow on working hours, coffee breaks, dress 
codes and personal leave. Several had Introduced flex-tlme or relaxed chaln- 
•ot-command requirements. They said that flexibility was necessary to motivate 
statf productivity and maintain morale. However, In all of these high 
performing offices, flexibility was coupled not only with greater communi- 
cation and staff discretion but also with accountability systems that 
permitted the manager to monitor staff performance levels.** 

f 

Data on managerial delegation of program authority (i.e. decisions 
•on service delivery and case management) to staff revealed a similar picture. 
AS Table 9.1 suggests, performance variation was associated with greater 
delegation of authority in combinatioji with more monitoring and exchange 
of information.*** o © 

Table 23 shows that 12 of U low performing offices had managers 
wtio were either reluctant to delegate or delegated responsibility without 
much monitoring qr transfer of information. High and average performers 
were more likely to have delegative managers who emphasized accountability 
and responsibility along with delegation. In the best performing offices, 
a high degree of delegation was combined with strong internal monitoring 
and extensive exchange of ideas or information. Staff had considerable 
control over how they scheduled theii work and performed their tasks, and 
they were Included in Internal decision-making. They were expected to 
abide by those decisions and were held accountable. Managers said that 
they allowed different degrees of discretion to different staff, giving 
more structured assignments to those who "needed direction", 
o 

Throe high performing units had formal managers who Involved 
themselves little in local program operations. One was an ES manager, 
the other two were WIN managers covering more than one office. These 



*There-was a .381 correlation, significant at the .01 level, between 
flexibility and local unit performance In our sample. 

**Thls Is not to say that a WIN unit can never succeed under inflex- 
ible management. In two- fairly high performing sample units, procedures 
were scrmtured and policies were Inflexible. However, staff were kept 
well-informed, manager and staff exhibited a close relationship and mutual 
respect. There was no apparent tension over the manager's inflexible style. 

***In our sample, there was a correlation of .397, significant at 
thy .01 level , between performance and type of delegation. 
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managers delegated total program responsibility to staff and were person* 
ally supportive. But they did no monitoring and had limited program ex- 
pertise. Staff worked together in two of these offices to develop close 

relat lonshlpd with the SAU and other organizations as well as Innovative 
job search and jo^ development techniques. In one of them, staff set up 
their own collective decision-making processes and worked cooperatively 
on most matters* In the third office, the WIN staff received direction, 
guidance and assistance directly from the state WIN st^ff. In all three 
cases, the staff was able to succeed despite lack of leadership from the 
formal manager. 



T.iblo 23 
Local WIN Sponsor Managers^ 
Approach to Delegation to Staff 



Reluctant to delegate • Assigned 
all tasks. Little staff discre- 
tion* Manager handled ''exceptions" 

Delegative, but no monitoring or 
accountability. Perhaps dis- . 
interest or "non-manager". 



High 
Performing 
Offices 



Average 



Low 



Performing Performing 
Offices Offices 



Total 



12 



Moderately delegative. Tasks are 
assigned, but some discretion in 
scheduling, case responsibility, 
daily tasks. Some monitoring 
occurs . 



11 



Very delegative, but with detailed 
monitoring and accountability* 
Substantial manager-staff inter- 
action* Staff involvement in task 
assignments, planning or goal 
set t ing . 



39 



I nnovat I ven ess . The overwhelming majority of local WIN managers were either 
mi^derately or highly receptive to innovation, according to their subordinates 
<Hul thetr superiors* Twenty managers were identified as moderately receptive. 
Thov were reportedly willing to listen to staff suggestions but rarely had 
Iniuwatlvt^ iderxs of their own* They were also inconsistent in their willing- 



tuvsq to .u t on new Ideas proposed by others 
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Thirteen others were classified as very innovative* They encouraged 
statf Ideas, suggestions and feedback. They tended to develop their own 
Innovations or experiments and ^to request waivers or funds to test thera# 
Innovative managers might, for example, restructure their units, attempt 
different ways of delivering services, or develop special projects for sub- 
groups of registrants such as WIN youths or unassigned recipients* In 
several high performing units, techniques were developed for promoting WIN 
with employers. Increasing job development activities, or streamlining paper- 
work for OJT contracts. Some Innovative sponsor and SAU managers also jointly 
developed projects to better utilize resources outside the program. 

Only five of the 43 managers studied were described as resistant to 
cliange or reluctant to consider innovations. 'These five were also described 
as cautious, concerned about their own positions or unwilling to attract 
central office attention to their units. None were in high performing offices. 

Communlca t ton . As Tahh^ 2^ suggests, the WIN sponsor manager's posture 
tf^ward Intra-office commtin Icat Ion was significantly associated with per- 
tormance.* Managers In better performing units tended to emphasize 
systematic distribution of Information and mo.re frequent Internal discus- 
sion. They encouraged staff feedback on regular program guidance and 
distributed WIN-related research studies or news articles. In low perform- 
ing offices managers generally shared less information with staff. In 1 1 of 
14 low performers, there was also little managerial concern for discussing 
Information that was received. 

Mmagers' communication style appeared related to their motivation 
and accountability techniques and to staff perceptions of managers' expertise. 
In the 18 of f Ices vhere communication was emphasized, staff said that, because 
they were kept Informed, they felt more responsibility for results* These 
offices tended to have more effective systems for reporting and for early 
Identification of potential problems. Their staff had positive perceptions 
)( the manager's program expertise, reporting that their inanager could provide 
pt)llcy or technical assistance when they needed it. In contrast, staff in 
offices with less emphasis on communication often felt their managers could 
add little to their own program knowledge. 



*Tho correlation between manager's posture toward communication and 
portnrmanc^^ In ^ur A'J sample offices was .437, significant at the .01 level. 



I'.K' 



1 ^ » 
4 



Table 24 
Local WIN Sponsor Mana&ers^ 
Posture Toward Comrounicatlon 



Little or no sharing of Information 
with staff, except perhaps routine 
personnel or program memos. 

Routine downward distribution of 
information, but no effort to 
coordinate or discuss. Little 
or no Interest In staff feedback. 



High 
Performing 
Off Ices 
0 



Average 
Performing 
Offices 



Low 
Performing 
Offices 



Total 
10 



10 



vSystematic Information distribu- 
tion, discussion and feedback. 
Information broadly shared. Con- 
scious effort tO' encourage staff 
feedback . 



12 



32 



Interper sonal interaction with staff . With few exceptions, staff charac- 
terized their manager as approachable and sensitive to their personal or 
career concerns* In only seven offices (none high performers) staff reported 
that the manager was insensitive, harsh or unapproachable. Where Insensl- 
tlvlty or aloofness did exist, the manager's attitude was sometimes counter- 
acted by an Intermediate supervisor. In only two offices was the manager's 
harshness so serious a concern that staff dwelled on it during Interviews. 

Willie most subordinates saw their managers as sensitive and accessible 
more staff in high and average offices felt their managers were willing or 
able to act in their behalf in personnel or policy matters. This was true 
in seven of ten high and eight of 13 average performers. On the other hand, 
managers in low performing units were usually described as either accessible 
and friendly but ineffectual (six cases) or harsh and aloof (four cases). 

Our analysis of SAH managers' style focused on the 13 sites where 
the SAl! consisted of five or more staff and there was some on-site super- 
visliMi^ We touiui very little variation in SAU management style across 



these units. Staff in all of them said their supervisors were accessible, 
reasonable and sensitive to staff career and personal concerns. Workers 
generally felt that the procedures were tight and" the paperwork burdensome, 
but In al L I ) units they aald their supervisor allowed leeway wherever 
possible.. Staff consistently reported the. atmosphere within their unit was 
frltMtdly, Informal or casual. 

SAU managers were generally reported to be receptive to Innovations. 
In fact, eight of the 13 were promoting demonstration projects on alterna- 
tive methods of delivering services. In some offices SAU staff were counsel- 
InK unasslgned recipients or conducting some sponsor functions, such as 
development ot job or training slots. Some were operating demonstration 
projectH Involving the use of Title XX funds, for example, to train WIN 
youths or to help WIN mothers become eligible/for day care licenses. Several 
were Involved In the development of systems f6r coordinating WIN reporting 
with other state and local welfare programs. 

Some variation was observed In delegation of authority and account- 
ability. Seven of the SAU supervisors allowed a moderate -degree of staff 
discretion but d id a minimal amount of monitoring. These seven were often 
described as "coordinators" by themselves and by their staff. They were 
available for advice, information and guidance but did not exert much control 
or accountability. The other six supervisors were very delegatlve but 
they had regular monitoring systems which they used to Identify staff develop- 
ment needs as well as for accountability. 

A-l though several components of WIN sponsor management style were asso- 
ciated with local program performance, SAU management style was not. This 
may he partly due to the small size and lack of variance of our sample. But 
it may also be related to the fact that local SAU's are not directly responsi- 
ble for conducting or reporting any of the major activity categories currently 
used by the national program to measure performance (see Chapter 2). As a 
result, it is difficult to determine whether a particular SAU Is performing 
well or badly and, thus, whether it is optimally managed or structured. 
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• CHAPTER 10 
SERVICE DELIVERY PROCEDURES 



The purpose of all the elements of WIN discussed to this point 
Is to provide structure, support and guidance to the actual delivery of 
services to program registrants. This chapter focuses on those services. 
Procedures for delivering services are prescribed in some detail in program 
regulations, handbooks and directives. However, considerable variance 
was observed In the way local units actually conducted some service delivery 
functions. This chapter describeis those variations and identifies which 
ones were associated with local unit performance. The procedures and 
functions examined fall into three categories: 

Standardized Procedures Guidance and Services Employment /Training 



Regis t rat Ion /Appraisal 
Employablllty Plan 
Certification 
Fo 1 low-up 
Adjudication 



Labor Market Exposure Placement 
Job Seeking Skills PSE/OJT 
Supportive Services Training 



Several important perceptions emerge. First, our findings suggest 
that high performing WIN sponsor units tend to deliver key services such as 
job search assistance and job development differently from lov performers 
and from mainstream employment service units. Second, contrary to some 
expectations, our data Indicate that the role the SAU plays and the mix 
of supportive services it delivers may influence overall local program 
performance. 

Lastly, the Information presented here, although limited by the 
nature of our study sample and the character of our data, has important 
Implications for the future delivery of welfare-employment programs. Whether 
the Implementing structure is the same or different, many functions similar 
to those In WIN will have to be conducted at the service delivery level to 
serve clients with similar barriers to employment. Successful strategies 
developed In local WIN units would provide Insights on how to better facil- 
itate employment of welfare recipients. 



1 . Standardized Procedures 



Procedures that were fairly standardized and required substantial 
paperwt^rk were performed routinely in most local WIN units. With few 
oxr^ept l(nis » little variation or association with performance was found. 
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t r >4 Uj)n /Apj)_r a I sa 1 

Welfare departments are supposed to refer to WIN those AFDC appli- 

^•.mts .md rt'c-lplfnts who art> required to register for the program. Those 
piTHoiis nut r.-qulred to register are to be informed about WIN and given an 
"PI^>^rt.m<t y lo v .>l unt.H'r . According to WIN staff, the mandatory registrants 
were gen»-rallv rt'ferred according to' procedures . There were, however, 
i-omplaints comerning the lack of volunteer referrals?* Staff in four of 
th»' study states reported that the number of mandatory referrals to WIN 
!>.ul sub.-it lut iai ly decreased over the past year. Local units that were 
i-xper lenc ing a viecroase in mandatory registrants were making efforts to 
ou'-ouragi.' tnort' v.)lutiteers by improving coordination with the IMU, develop- 
In^'. tnitr.M. h pr^r^rams, or exploring training opportunities wtilch could 
attract vol mfteer ^ . Wiere the flow of registrants had remained constant, 
little priority was put on serving volunteers. 

Rr.'.istration for WIN was handled either at the. welfare Intake point 
•or .\<: fi.. WIN office after referral from Intake. In many places attempts 
w.-rt' made to .ivoid needlessly "shuffling" the clients back and forth. In 
tour sites sosnt- WIN sponsor staff wore located In the welfare office to do 
iimiuHil.ite registration and appraisal. SAU staff In two places conducted 
prt-apprais.il s in the home and began arranging needed services or prepared 
lorms vwi written reports wiiich speeded up the formal appraisal. In several 
inruan.rs $A': or sponsor staff transported clients to the office for appraisal 
o{ their empioy.iblllty and service needs. A joint sponsor-SAU "group 
apprais.i!/.>rientnlon" was conducted in one office to complete necessary 
pap.-rwork hot-^rv cll.'nts were Individually seen by counselors. 

!n !S sitps appraisal sessions were held at the time of registration. 
In tho \^t!u'r :h sites registered clients were scheduled to return for an 
apprais.il session, usually within a few days of registration. High performing 

• >;ti..-os wro just as likely as low performers to have separate registration 
and .ij^pra i s.i 1 . 

*The proportion (jf voluntary registrants may have been related 
t.i tlu' samplf states' average AFDC grants. In two states with very low 
At.iur: levels, volunteers comprised 50,!; or more of the "total number of 
rev. i St rant s. In the sample state with the highest grant there were very 
few volunteers. Ln,-al staff across the ten states were not in agreement 
on r!ie emplovab i 1 ir y of volunteers compared to mandatories. Many said 
tl; It v.'ltmteers were only interested in training or had unrealistic expec- 

• '-i'^;'- \' ;^hs they could qualify for, so they often dropped out of WIN. 
Hewevet , others reported tliat volunteers were more "motivated," easier 

pl 1- •• c-.d nil b.-tter retention rates. 



We tound no * a'SHoc tat Ion between performance and joint 'apprai> l3# 
In 25 ot the 43 sites visited. Joint appraisals were conducted whenever 
possible. In 13 places there were sequential appraisals; and In five sites 
welfare or SAU staff appraised, but sponsor staff did not.* Whether or not 
the appraisals were joint also had little to do with collocation.' Eleven 
of the 2*) totally or partially iM)llocated offices did not conduct joint 
appraisals* Two reasons were often given for separate appraisals. First, 
WIN sponsor statt usually outn-urabered SAU staff *and an SAU worker might not 
always bo available. Second, many SAU staff said they preferred separate 
sessions because they felt sponsor staff tended to do^nlnate Joint Interviews, 
aftordln^ the SAl' little opportunity to appraise the clients'' service needs. 

tlmployab 11 lt> plans are Inte^nded to help establish a client's 
oci upat louvil ^^oal and servlv-:e needs. The plans were usually developed 
at thv' t imt> (^t appraisal. In 2\ sites thi?y were not taken seriously by 
staff and were considered just **more paperwork". In some localities staff 
belU'Ved thert^ was very little choice in the type of job a client might 
obtain, and ortt.'n L!ie option of ''training" was limited to obtaining a high 
si'hool ecjulv.i! fui'v . In seven other sites staff emphasized developing 
the plan and often Involved the client. They knew the plan would be mean- 
luRless wtien It ramL- to actual referral or placement but continued to 
emphasl/o It as .i tool for motivating clients. 

In the other 14 sites, the /employab i I tty plan was emphasized, 
ronsldfred realistic and used for |Lase manav^ement. In four of the 15 
the SAU had real Input in developing the plan. In the other ten sites 
WIN sponsor staff In effect operated alone, even though SAU staff might 
ai'tualiy bo present if the plan was completed at joint appraisal. There 
was no a'^so*: I at Ion between developing meaningful plans and overall per- 
f onnane t» .* * 



^KvUir of thr^ live were In the state where the welfare department 
oprrited t!i»; pro'^ram. Intake functions for all the department's programs 
w^^rv I'fut ral i zed ^ and appraisal of services needed by WIN registrants was 
done at the Intake point. 

**!lowever, In some offices, the plan was used as an Integral 
part ot t'ne )i>b si: irch process and was i^ften modifLed.as the clients 
LMln.'d 'h^rc in^u'.ht into their own eapnhilitlos anri labor market reali- 
ties. !'r.^vi^i.>n jv-^b search skills was related to performance, as dis- 
cussevi I lU'r in this chapter. 



o 
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Certification 



In all but five of the 43 sites, a "request for certification" for 

supportive services was submitted to the SAU at the time of appraisal. In 
tho other tlVe offices a request was made only when a job became available.* 
There was however substantial variation In how the process was handled. 
It no services were required, the certification process was often "automatic", 
ineanlnK the certification forms were completed on the spot. In some places, 
all cert if Ic-at Ions were automatic, then, If a job was available at a later 
Lime, the SAU would try to arrange needed services. Automatic certification 
was most common In two states where the SAU central office had emphasized 
maximizing the number of certifications. In other sites, however, certifi- 
cation was not requested If services were not required. In one large urban . 
area there was no available licensed child care at all, so no certifications 
were requested If child care was needed. If a job was available, clients 
were told to try to find their /own child care and were placed without certifi- 
cation. In another urban sltei' certification requests at one time had been 
delayed up to 18 months. Slnc^.office policy was that registrants had to 
bf certified before moving on to the next unit for counseling or placement, 
hundreds of clients had not proceeded past the appraisal point. 

As discussed In Chapter 2, analysis of program reporting data revealed 
no association between number of certifications and performance. Our site 
interview data suggests that there Is wide variation among states in the 
oert if Icat ion requirement. Thus, It may be futile to compare states on the 
number ot certifications requested or completed, with or without services. 
It may be -nore meaningful to compare the types of supportive services or 
•■ounseling clients receive, as suggested later in this section. 

^ ' I ' ' IE y ^ss ^ 

The ]n-day t'ol low-up contact on clients entering employment is crucial 
to th.- retentlvMi rate performance measure. At the time of our fieldwork, 
most local staff knew the Importance of the follow-up, and managers were 
.•nipliasl /.Inv; it. I;i only seven of the 43 sites (all low performers) was there 
''^•if^ the 5{)-d.iy follow-up was not being done conscientiously. In 
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most .uruT pla.-os the employer was called first to verify employment, but 



*'hu' hl.;:i p«;riorm{n); state program requested and was granted a waiver 
t\'^ r.^i-nal ottice allowing the use of WIN funds to provide services 
[■ iPp'i'" i"Hs uPt yet actually on the AKDC rolls. A high performing office 

moth."- stite had special demonstration funds that could be used to certify 
111 irr-i-i>:.' s.-rvi-fs for AFDC applicants. Tn two other states Title XX funds 
•! r. I i ^:t. m.-c tunrls wore us-'d for AFDC-U applicants needing services. 
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staff In several of f Ices . contacted the client first If they, thought the 
employer might react adversely to learning that the client was on welfare^ 



Four local offices routinely went beyond the required 30-day contact • 
in two oi these (one high and one average performer) , clients were contacted 
^ once a week within the 30-day period. In one other high performing office 
there were regular 30-day, 60'-day, 90-day and 6-raonth follow-ups. Sponsor 
and SAU follow-ups were coordinated to avoid duplication. In the fourth 
site (also a high performer) there was a 90-day follow-up In addition to 
,the 30-day contact, plus a spot check on two or three percent of tl!y^,.^;||^ace- 
menta after two years. ^ 

Ad jud Icat Ion 

All registrants are entitled to have appeals or grievances heard 
by a review panel under WIN adjudication procedures. Mandatory registrants 
who are not cooperating with WIN can be dereglstered from the program and 
have their AFDC grants decreased. These registrants are .entitled to a 
hearing before their grant Is cut. "Sanct lonable" behavior Includes refusal 
to appear for interviews or to accept offered employment or suitable child 
care. The WIN sponsor must Issue a formal '^notice of Intended deregls- 
tratlon*' informing the registrant of Impending action, explaining the reasons 
for sanctioning and offering assistance In preparing a hearing request. 
Tht* WIN sponsor Is supposed to attempt to reconcile the situation with the 
client within ^0 days of the notice. Once the WIN sponsor or designated 
hearing v>f fleer has determined that the refusal to participate has been 
without gi)od cause, the SAU is supposed to attempt to persuade the client 
to participate daring a 60-day period of counseling. The client Is then 
either returned to the program or dereglstered and the grant cut.* 

Some of the most frequent complaints local staff had about the WIN 
program concerned the adjudication process. The problems most often mentioned 
concerned rommun icat ions and coordination between the WIN sponsor, the SAU 
and tht» IMl'. Many v>taff said IMU workers did not understand WIN procedures 
and often did not iM^mmunicate grant actions to WIN staff. 

ft 

In thrt;»e 'U' the study states adjudication was given high priority 
and several WIN sponsor staff at the state and local level worked full time 
on ad j ad i<Mt l.-^n . i.^cal staff In these states, however, reported very serious 



*rhe IMl* is notified of dereglstrat ion and must adjust the family's 
grant <ir r ord I n^; 1 y • Tht* dereglstered client's portion of the grant Is 
d»Mtui*t*Mi \[\t\ 1 ^'protective payee" account Is established to provide the 
AFIH* iss I s r by paying vendors directly. After 90 days, the client 

mav rv»-.ipplv t-^r WIN .nid , it ct^opp rat ive , have the full grant restored. 
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pcooedura problems. They had difficulty obtaining grant change information 
from TAW IMi: and also cited problems in coordinating sponsor and SAU func- 
tions. Overloads seemed a contributing factor. For example, In one urban 
offirt^ there was an average of flvt' new 6U-day counseling, cases for each 
SAU worker ev.iry w.ek. That SAU had several staff vacancies and couldTot 
possibly counsel all the cases referred by the sponsor staff. Many clients 
were dei eg (.stored after bO days whether counseled or not. In four large 
local programs the IMU was very slow in completing grant changes, in one 
case being over a year behind. Thus, many clients who were deregistered 
on p.iper were unaffected In reality. 

Outside if these tliree states problems were reportedly less severe. 
(.•o.>rdln,itirn wUh the IMU was a continuing problem, as discussed in Chapter 
n. out WIN statf said they could usually follow-up on adjudicatioa cases. 
l.u> stariis o! individual clients and grant changes could be checked with 
the IMI.. other problems centered on disagreements between sponsor staff 
and hAL start ibuut whether a "notice of Intent to dereglster" should have 
heer. Issued . SA'' staff knew the sponsor had final authority on the decl- 
SUM1S, so th.' disagreements were usually not prolonged. 

Ther.. was great variation among local units In the emphasis placed 
>)n ad]udrcatlon. in part reflecting local attitudes towards welfare. In 
states or .:ou,uies where we were told there was a negative public attitude 
toward weltare, WIN was more likely to emphasize adjudicating non-cooperative 
clients, especially men. In other places WIN staff were not as anxious to 
. ut grant-^. In two states there was an aggressive attitude toward quickly 
s.uu-r ion i-ig !n<>n, but women were treated more leniently. 

In general, ail states had adjudication plans and procedures, and 
•u'st I;K-aI pra^raras (24) emnhaslzed adjudication for non-cooperative clients. 
As '. i:. 1, J, W-ws, staff in seven offices said they had "enough clients 
who want to work", so they did not bother with those who did not want to 
.-.loporate. In seven other offices we were told they rarely initiated ad- 
i.idU-atlou. sin-:,, most clients cooperated. Staff in these places felt most 
pr.)blems could he solved without full sanctions and emphasized counseling 
individuals '^ho seemed uncooperative or missed appointments. 



Table 25 

Local WIN Pollclea Toward Non-'Cooperatlve Clients 



High 
Performing 
Offices 



!• Little or no adjudication; 
"don'^t bother with clients 
who don't want to cooperate 

2* Kmphasl2lng adj ud icat ion » but 
many procedural problems, and 
_H_tt^le counselin g • 

It Very little adjudication needed; 
emt;has l?e counseli ng the few 
. wtu) don't cooperate t 

4* Kinphaslze ad j udlcatlon, particu- 
larly 60-day counselin g; sponsor 
and SAU In agreement. 

( Insuf f Ic lent In format Ion) 



Average 
Performing' 
Offices 

^ 1 



Low 
Performing 

Otfices ^ Total 



17 



43 



We found no relationship between performance and whether or not a 
local unit emphasized ad ) ud Icat ion • However, there *was an association-^ 
between performance :ivA how local offices dealt with non-cooperative clients** 
As Til/ii' J"": also Indicates, all ten of the high-performing units In the 
sample emphasized counseling and working with those clients. Five of the ten 
followed regular adjudication procedures, particularly emphasizing the SAU's 
OO'-day counseling* Staff felt the counseling was very effective and that 
full s.\aotlons or grant actions were usually not necessary • In most cases,, 
the WIN sponsor staff consulted with the SAU before issuing a "notice of 
Intent to dere^lster", thus minimizing the possibility of later disagreement* 
In the (Uher five high-performing programs, very few cases ever entered the 
adjudication process* Staff in these offices said they counseled Individual 
clients and rarely had to initiate formal action* 

• 

In contrast , In ten of the 15 low-performing programs there were 
either serious prob leias with the adjudication process (4 cases). Including 
dert^g ist r at Ion witnout 60-day cotinsollng; or staff simply ignored those ' 
clients wlio refu.sed to participate (6 cases). 



*Tl\or»> wi^ a 'M^rrelation of •40Q, significant at the ,01 level, 
bt»twiMMi liNMl unit performance and method of handling non-cooperative 
clI'Mits. IS rtporttHl in Table I0«1, 



2. Guidance and Services 
Labor Market Exposurfe (LME) . .j ' 

According to the WIN Handbook, clients in AFDC applicant status are 
to be pla.n>' In LMK and given access to job listings and Job Bank and exposure 
CO job search possibilities. In only one state in our study was LME defined 
in this way and emphasized. In that state. all applicants for AFDC were put 
into LMK, and all males were expected to find jobs. In fact, 60% all lob 
entries In that state were from LMK. In the other nine states ail registrants 
were instructed in using job listings or Job Bank tnlcrofiche, but there was 
general agreement that LMK rarely led to Jobs unless it was integrated with 
training on how to search for a Job. 

In the ten local sites where staff said LMK was emphasized, we found 
that otten this meant all registrants^-not Just AFDC applicants. In all ten 
ot these sites, LMK was used as part of the job search component. But, 
many ottice.s th.it reportedly did not emphasize LME were in fact providing 
the same exposure individually or as part of the intensive manpower services 
component (IMS). There was, therefore, some discrepancy on how LME was 
detlned at the local level, whether Just AFDC applicants were put into the 
component for reporting purposes, and what staff meant when they said LME 
was (or was not) emphasized. 

Job .Seekln>> Skills 

There were similar deflnitiorial problems with the intensive manpower 
services (IMS) component. IMS components are meant to provide cll-^nts 
with necessary job seeking skills. Thirty of the sites studied. Including 
all ten^of the high performers, did have established methods for improving 
clients' job search ability. In some offices this was called IMS, but 
In others the skills were provided in an "orientation" session. In two 
high pertorming units there was no formal orientation or IMS, but staff 
individually counseled and trained all clients in Job search and job inter- 
view techniques. 



classifies sites by their method of providing job seeking 
skills to clients. In 13 offices there was little emphasis on Job search 
•ictlvlty evt-n though five formally had an IMS component. In four of these 
five offices clients were merely told to apply for a certain number of 
jobs and report back In a week or two. They received minimal staff guidance 
■xnd no monitoring. In the fifth, WIN contracted with a community organiza- 
tion to provide joh search skills, but only a small proportion of clients 
wtTc referred to those classes. 



Table" 26 

Local Provision of Job Seeking Skills 



High Average ' Low 
Performer Performer Performer Total 

• It tt ;e attention 
to providing Job 
search skiMs. 

No oraphasls on J (IMS ''on paper'' but*- i 4 5 

Job search as-» \ not emphasized,) 

slstance / (No IMS or other - 4 4 8 

method used to pro- 
vide skills.) 

No formal component ,2 - - 2 . 

but prtorl'ty given 
to provid Ing ski 1 Is 
through Individual 
counseling t 

Kmphasis on \3. Kmphasir-, on provid- 2 4-6 
job sear^rh j Ing skills through 
asslstaui-e / g^roup or lent at ion * 

♦ Hlmphas is on prov Id Ing . ^ 
skills . through IMS 
Component ♦ 

(Group IMS.) 3 6 6 15 

(Individual IMS.) 3 3 - * 6 

( insot'f icient Informa- - - 11 



^ tlon 43 

Turf^nt y-ont^ sites had formal IMS uomponents and emphasized providing 
clit»nts with job search skills. Fiftee:. of these had group IMS sessions 
which tvpic^^lly v:'^n*slsted of about one week of orientation or Job guidance 
wt^rksbop and In^jiiided role, playing^ interview techniques, grooming, and cut* 
Hide speakers. \ period of monitored job search activity followed which 



lasted up to eight weeks in some places.* This Involved weekly or even daily 
contact between client and staff. In several offices the emphasis was on 
cllet.is doing their own job search. In others, staff referred clients to 
specific openings. In six offices staff worked with individuals rather 
than groups during IMS. ^ 

. In. the 21 offices with a functioning IMS program, the most lob 

ready clients were formally placed into the component. However, in eight 
of these offices, everyone, informally received the same type of job search 
training. Stp.ff in two high performing offices told us all registrants 
were really in IMS, but "we just do paperwork on enough of them to reach 
our quota. 

Six offices had intensive, group orientation sessions for all regis- 
trants. These, sessions were in many ways identical to group. IMS sessions 
u other sites and were followed by individual counseling and referral or 
Ob search. In fact, at least three offices had both group orientation P.nd 
IMS. with much duplication in the two sessions. In all three cases, there 
ha(l always b.^ni an intensive orientation, but an IMS was added to comply 
with program directives. IVo small high performing offices d.'.d not have 
an IMS or a tormal orientation, but staff emphasized providing all clients 
wUh job seirch skills and labor market Information. 

Ihus, having a formal IMS component did not necessarily mean clients 
w.Tt. improving their job seeking skills, staff in high performing 

*There were various types of group IMS sessions. For example, 
two states had recently begun "Job Club" approaches in some offices, 
• lu'tus met In groups, discussed job search issues and shared leads on 
•'mploym...nt oppor t 'in 1 1 1 es . Another state had a module system of orienta- 
tion guidmce, job search and placement, and clients were assigned to 
modules depending on the amount of job preparation and guidance needed, 
in lour ;o.'al sltvs the IMS activity had been contracted out to community- 
.>ased org.iPUatlons. Some states had strict guidelines for local units 
to follow in netting up IMS plans, other states left this to the discretion 



offices were more Itkely \ \ low performers, however, to have a conscious 
policy for provldlnf' lob h^-^^^^^h assistance** In all ten high performing 
offices priority was placed on Improving all registrants' job search skills 
and kuowled>^e of the labor .market . 

Tbere wa.-; als^^ a slgnltlcant assn.-I u ion between performance and 
wtierher or mn cMlents d L.^ their own job search*** As 'lYible 27 indi- 
cates. In halt of the high pertorming units, clients were expected to 
use the skills provided and find their own jobs, (with staff guidance). 



TabU^ 27 

Loca l Emphasis on Client Job Search 



High Average Low 

Performing Performing Performing Total 



It Little provision of Job 
search skills. 

2. Staff provide k^Llents with 

job search skills, then 
refer to openings. 

3. Staff provide clients with 

job search skills, then 
expect them to do own 
job search. 
( Insuf f ic lent la format Ion) 



5 

12 

1 



8 
4 



13 
21 

8 



43 



Ai:c(^rdln>^ to program guidelines, WIN can provide clients various 
types ot supportive services, mainly through the SAU. These services 
Include rhlld care, remedial medical assistance, counseling, family planning, 
financial mani^ement, transportation and emergency funds. Clients can 
also be referred t^ other ^igencles for these and other services. 



*'Hu^re was a significant correlation between performance and 
emphasis placard oii providing job search skills (r = . 373 significant at 
the .01 lovel). Performance was not associated with wiiether the skills 
were pri^vidtul tt>rmally or Informally, In a group or individually. 

**rhere was a correlation of . 370, significant at the .01 level, 
between p»» r r • ^ rm itir r» and the three categories of client job search* 
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k^lUi_care. Child care was. the main supportive service provided WIN cllents 
In our sample sites. In 24 of the 43 sites there were serious problems in 
arransln« needed child cart^. Staff reported shortages in number- of licensed 
day care homes and centers. The problem may have been understated since 
tour ot the 11 sites that did not feel child care was a problem were in a 
state where WIN concentrated on placing men and did not provide child care 
or their children. Staff in four other sites said they had enough care 
tor pre-school children but had problems with after school, infant, night 
and weekend care. Availability of adequate child care was a problem in both 
high uul low performing programs, and the shortage was probably one reason 
wiiy SAL s i)tteu underspent budgeted funds. 

A.:cording to local staff the day care shortage affected the program 
tn several Vays . Some staff mentioned that the shortage of child care gave 
some mandatory woraeu registrants an easy excuse for not cooperating. They 
said that clients wlio were seriously interested in working could usually 
arrange their owl^ ohUd care. Those wlio did not want to work knew that If 
they latormed WIN' that they could not find a babysitter, they would not be 
loicod to work. 

Feder.iL tunds Cor day care can be used to pay licensed homes or 
centers. In 18 o: the 43 sites studied., however, most child care was 
reportedly provided by friends or relatives of clients, as Table 28 
tndlcat^'s.... In several offices clients were urged to find their own baby- 
si tt.-rs. But It is uncertain whether informal care was used because of the 
v^em.ral s;,orti.o^ of licensed care or because parents preferred friends or 
relatives.* I'redominant type of day care was not associated with local 
p r og r . un pert.) nn a nee. 



*Stual.-s show that the most prevalent type of child care nationwide 
Ini,^r:n,il. Ihe few studies on parents' preferences indicate that parents 
t ill .-NMionih- .-lasses tend to prefer informal care for their children. 
Vv\).-.l V (iQ.'h) and Woolsey and Nightingale ( 1976). 



Table 28 

Predominant Types of Child Care Arrangements 
■ for WIN Clients 



High 
Performing 
Offices 



Avt^rage 
Performing 
Offices 



1. Most care ta In day care 
centers . 

2. Most care Is In licensed 
day care homes. 

3. Use centers and licensed 
homes equally. 

4. Most care Is by babysitters 
friends, or relatives. 

(Insufficient Information) 



Low 
Performing 
Offices 

I 



Total 
3 

11 



10 



18 



43 



Other supportive servic es. The provision of services provided other than 
child care seemed associated with performance, as Table 10.5 indicates. In 
four low performing offices very few services other than child care were 
provided* In 24 programs the SAU provided child care and referral for other 
services, but only In certain cases did these SAU's do counseling or make 
home visits (I.e., 60-day counseling and checking child care arrangements at 
home). Many SAl! staff In these sites felt their training as social workers 
was being wa s t ed . 

SAU staff in the third category were much more involved with all 
clients. They counseled clients jointly with sponsor staff. Home visits 
were considered very Important and were done for all registrants. In some 
cases SAl' staff were developing programs to train day care mothers, or were 
participating In role-playing sessions In IMS or orientation. They provided 
counseling on family planning or household management and emergency money or 
transportation for clients. Seven of the ten high performing local programs 
provided a wide range of services.* 



*Thore was a correlation of .381, significant at the .01 level, 
between performance .ind provision of services as categorized on Table 29. 
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Table 29 

SAU Provision of Supportive Services 
Other than Child Care 



High 
Performing 
O.f f.ices 



U .Halnly child care. 



2. 



Mainly child care, plus 
counseling or home visits 
for certain cases only. 



M^my services or activities 
beyond child care, for 
al 1 cl-ients ». 

( InKuf f ic lent information) 



Average 
Performing 
Offices 



12 



Low 
Performing 
Offices 

4 

9 



Total 
4 
24 



14 



43 



XiJli^JlX' WIN "(if ten has access to resources from other community agencies. 
While links to other .local programs will be discussed in Chapter 12, Title 
XX will be examined here because of its importance in the provision of 
supportive services. 

The most frequent connection between WIN and Title XX occurred when 
an employed client was dereglstered from WIN, and funding for continuing 
social services was transferred from WIN to Title XX. As Table 30 Indicates, 
In eight sites studied this was the only contact WIN staff reported having 
with Title XX. Problems in this transition were sometimes reported to 
influence WIN clients' job retention. Staff in several local offices said 
that It was not uncommon for a WIN client to quit a J ob If a disruption in 
day care occurred. 

In 17 dltes staff reported smooth transitions to Title XX funding, 
with little or no dif:ruptlon of services or payments. Fourteen of these SAU's 
were In Title XX units of county welfare agencies. The transition of cases 
was smooth partly because SAU workers often had Title XX responsibilities as' 
well. Three other sites reported fairly smooth transition because the SAU 
notified. Title XX 30 days In advance of case transfers. 
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Table 30 

Local WIN Usea of Title XX Resourcea* 



High 
Performance 
Offices 



U No use of Title XX (except for 
transition after SAU coverage), 

2. Rttfer to Title XX for services 

WIN can't provide. 

3. Can use some Title XX funds for 

services as well as referring. 

4. Substantial supplement by 

Title XX (funds, staff) plus 
services and referral. 
(Insufficient Information) 



Average 
Performance 
Offices 

3 

6 

4 

4 



Low 
Performance 
Offices 

2 

1 

; 

5 



Total 
,8 
9 
5 
11 

10 
43 



Staff In two states with very low average AFDC grants reported having 
few problems with transition to Title XX, evidently because so few employed 
clients required paid services. The main benefits WIN clients might continue 
to receive once they were employed were Medicaid and food stamps, and neither 
require contact with Title XX. 

iti ten other local units, the transition to Title XX was not smooth. 
Several staff said payments to vendors were usually delayed for a month or 
two, even though the service itself was. not interrupted. In two states locc 
staff said there was generally a disruption of either payment or service when 
the client transferred to Title XX. In some counties Title XX workers had to 
recertify child care before the vendor could be paid. Several SAU managers 
solved these problems by providing Title XX with advance notice of needed 
services, as mentioned above. 



*The Information presented here is based on interviews with local 
sponsor and SAU managers and staff and may understate the actual case. Some 
respondents might not have known whether Title XX resources were being used. 
Some county welfare systems do not readily distinguish between SAU charges 
and Title XX charges, and Title XX also sometimes provides general support 
for local programs. WIN might have referred clients to such programs without 
being aware of their Title XX funding. 
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Tahlo ^0 also shows that nine SAU's referred clients to Title XX 
only If WIN could not provide a needed service. For example, Title XX funds 

I'ould ot'tvn be used for emergency assistance, particularly for applicants not 
yet receiving AKDC. Five othsr SAU's consciously used Title XX services as 
much as possible. In two of them SAU funds were used^ for providing child 
oare, and Title XX w.is used for all other services. In the other three Title 
XX tunds were used for child care as well." 

Kleven sLtos received substantial resource supplements from Title XX, 
beyond rett'rrlns clients tor services or transferlng cases. In the state 
wtu^ro WIN was operated by the welfare department, Title XX funds were used to 
supplement regular WIN staffing levels in some units. In andther state Title 
XX-tunded staff arranged day care for WIN clients, much of wtilch was charged 
to Title XX. 

In two instances Title XX resources were used for institutional 
tralnliv.;. In one state a Title XX-funded counselor worked with WIN clients 
interested In attending college. This counselor and WIN staff coordinated 
activities with Local colleges, and Title XX paid tuition and provided 
social services tor clients admitted to approved programs. In another state 
an SAr manager had designed a demonstration program using Title XX funds for 
Inst itut lonal training. Candidates for this program were identified at 
appraisal and referred to SAU staff responsible for the demonstration. SAU 
staff counseled clients, developed contracts with junior colleges and voca- 
ti.mal schools, and monitored the progress of clients. In this case, too. 
Title XX funds covered both tuition and supportive services. 

The benefits of available Title XX resources were sometimes more 
apparent than real. One state SAU had subs: .ntlally more Title XX money 
available for day c^re than the entire SAU budget. Day care centers under 
Title XX contract, however, were not giving WIN clients the intended priority. 
In addition, these centers were often not open long enough to accommodate 
working parents. Many provided no transportation although located in areas 
Inconvenient for WIN clients. 

In two states. Title XX services and SAU services were used inter- 
chanv^etblv Ln many counties. Rather than bother with separate forms needed 
tv> report SAl' services, we were told some workers just charged the service 
to Title XX. This led to consistent underspending of SAU funds.* 

*In one of these states (a high performer), WIN and state welfare 
oftloials were developing a system to identify costs that could have been 
charged to WIN but had been charged to Title XX. The "recaptured" funds 
were being used to fund various WIN/welfare uemonstration projects based 
on prt'posals submitted by counties. 
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3. Rpplovment /Training; 



The ultimate objective of the WIN program Is to assist clients in 
obtaining employment that will lead to self-sufficiency. This Is achieved 
through direct placement. Institutional training, public service employment 
(PSK) and on-the-job training (OJT). Current program emphasis is on placement 
in unsubsldlzed employment. 

Job Development 

'IVil: If. '.I presents the four approaches to job development found in 
the study nttes. Since most offices used a combination of job development 
techniques, the categories in the table represent the predominant approach 
for each site. There was a significant relationship between local performance 
and the type of job development effort.* High performing offices tended 
to emphasize counseling and had a client-oriented approach toward placement 
activity. 



Table 31 • 
L ocal WIN Emphasis in Developing 
Unsubsidized Jobs 



Higl. Average Low 

Performing Performing Performing 
Offices Offices ' Offices 



1. 1,1 1 tie job development. 

2. Staff develop a pool of job 
orders for WIN. 



II 



7 



Total 
7 
18 



"3. Staff find or develop job for 
partt.'ular client. 



8 



Client does own ] ob search, 
with guidance and assistance 
of staff. 



8 



(Insufficient information) 



, 43 



*There was a correlation of .467, significant at the .01 level, 
between performance and the four categories of job development in Table 
10.7. When the two client-oriented approaches were combined into one 
category, the correlation coefficient was even higher (r = .547). 
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The job development methods used by loQal staff were often related 
to the type of job search assistance provided. Eight sites where Job develop- 
ment was cUent-orlented also had formal IMS components that emphasized and 
monitored clients' job search activity. In the other eight client-oriented 
sites, there was more emphasis on Individual counseling and on developing 
jobs for specific Individuals rather than having the clients doing their 
own search, ffight of the ten high performers were in these two categories, 
emphasizing individualized assistance. 

In contrast 18 other of f ices— mostl y average performers — placed major 
emphasis on developing a pool of job orders to be filled by WIN. These 
offices generally had "Job developers" whose main responsibilities were to 
maintain contacts with employers, promote WIN OJT and obtain Job orders. 
Several managers of these units had established quotas for number of employer 
contacts to be completed and emphasized improving employer relations. This 
approach toward employer relations and job development was similar to that 
usually found in local ES offices. 

Finally, seven low performing programs placed very little emphasis 
on Job development for WIN. Five of these units were located in ES offices 
wliere ES staff were responsible for job development and contract writing and 
controlled all job referrals. In all five cases the ES manager placed little 
priority on WIN, and FS employer representatives did not promote WIN or 
develop openings specifically for WIN clients. 

WIN OJT and PSE 

WIN can write contracts with employers who agree to provide a client 
with a full-time position and on-the-job training. Employers are compensated 
for non-productive time and training costs. A WIN OJT contract may be written 
f(^r a period up to 18 months and includes a commitment by the employer to 
provide a permanent position after the subsidized period. 

We found substantial variation in local use* of WIN OJT but no relation- 
ship to overall performance. In 16 offices staff felt OJT led to permanent 
unsubsldl^ed positions. They believed OJT contracts helped promote WIN with 
employers. Staff In these units said they could write as many OJT contracts 
as the central office would allow and that employers were very receptive. At 
the otht>r extreme 17 local WIN programs either had no funds at all for OJT 
contracts or had little success in gaining receptivity from employers. In 
some places WIN contract writers and job developers complained that even if 
contracts were obtained, staff often could not fill the slots. 
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similarly, there were mlx6d views on the usefulness of the/ tax credit 
that employers could receive for hiring WIN clients ♦ Many staff sbld employers 
were very Interested In the tax credit, that it was a positive tooN^nJ^^eTTing 
WIN clients" and that It, was always offered to employers* However, many 
other respondents said that employers were not at all interested or feared 
getting Involved In red tape or government audits. 

WIN can also subsidize full time public service employment (PSE) for 
registrants by writing contracts with public or private non-profit agencies. 
The employer must agree to WIN PSE regulations, which stipulate that regis- 
trants must not displace or substitute for regular employees and that the 
J'>b must contribute to the client's career development. The employer also 
must ofter a commitment to retain the individual in an unsubsidized position 
after the contract period. 

In general we found very little emphasis on WIN PSE In the local 
sites. In only eight places did respondents feel that WIN PSE was success- 
ful. Two of those programs contracted out WIN PSE responsibility to CETA. 
Two were In noa-urban areas with federal government Installations (a peni* 
tentlary and a military base) that had substantial demand for PSE workers 
whether from C^KTA or WIN. The other four programs had WIN managers who 
aggressively promoted PSE and were apparently unaffected by competition 
from.CKTA PSK. 

In lb sites CETA had captured nearly all local PSE activity. In 
the t ew of these offices that did use WIN PS E, the planned goal itsual ly was 
very low and contracts were closely monitored. Staff were reluctant to 
emphasize PSE since many state and county agencies could not guarantee 
transition to permanent employment. In five sites, however f there were one 
or two WIN PSK workers In the WIN office Itself, usually functioning in 
clerical or para-prof esslonal positions. Most reportedly transitioned to 
permanent WIN positions after the contract period. 

Inst 1 1 u 1 1 o n a I T r a 1 n i n >^ 

The WIN program currently provides very little money for Institu- 
tional training. State offices can allocate some funds to local programs to 
write training contracts, but national policy emphasizes 'that the training 
must bo carefully selected to assure long-term employment prospects. Most 
training received by WIN registrants In the 43 study sites was through referral 
to community institutions and programs, usually at no cost to WIN.* 



*Interai: t Ions with these Institutions are discussed In raore'"^et-«iI' in 
Chapter 12 p 



17 3 



/ 



Twenty-four of the local programs had no WIN funds at all for 
inatltutlonal training. Managers and staff In ten of these had developed 
a network of Linkages to other agencies and Institutions to which WIN 
clients couLd be referred. This network usually Included CETA. community 
colleges, local education and vocational rehabilitation agencies and technical 
Institutes. The other U units placed very little emphasis on training and 
had not developed such linkages. Very few registrants In these offices were 
ever referred for training. 

In eight other sites staff reported that training was not considered 
a top priority but that they did have some WIN money, to purchase Individual 
training slots or to fund a few classes specifically for WIN registrants. 
They also maintained contacts with outside agencies and referred clients 
to particular programs from which they could benefit, especially high school 
equivalency (GED) , adult basic education (ABE)\ arid basic educational 
opportunity grants (BEOG). In ti)$>ffe units training expenditures were closely 
monitored, usually by both state and local managers. 

In only seven sites were we told that institutional training was a 
very important priority. These offices had WIN funds available to purchase 
individual slots and whole classes. Staff in all seven also reported having 
access to CETA-funded training resources and referred many clients to community 
training organizations. Three offices had close contacts with local colleges 
and had developed classes for WIN clients in such fields as nursing, mechanics, 
radiology and secretarial. Several units were using Title XX funds to purchase 
slots from local educational Institutions, as discussed earlier. We found 
no relationship between performance and the amount of emphasis placed on 
institutional training. 



lii conclusion, there was a distinctive pattern to the way high 
performing local WIN programs delivered services. High performers provided 
clients wUh job seekit.g skills whether or not there was a formal IMS 
component. They had a client-oriented approach to placement; jobs were 
developed for specific Individuals. They were also more likely to emphasize 
thf counseling aspects of adjudication. SAU's were not limited to approving 
(.hlld care arrangements but provided a broader range of supportive services. 
These findings suggest several recommendations, discussed in Part V, for 
improving local perfortrance and for examining the relationship between SAU 
futn ttons and overall program objectives. 
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' CHAPTER 11 
INTERACTIONS" WITHIi^ AND BETWEEN LOCAL UNITS 



In this chapter we analyze the nature and frequency of Interactions 
within and among local work units. We begin b- examining Interactions 
within WIN sponsor units and SAU's. Then we tarn to communication and coor- 
dination between sponsor units and SAU's. Finally, we deal with Interactions 
Involving these two types of units and two other host agency units presumed 
to be particularly Important to WIN~employmeat sexrvice offices and income 
maintenance units (IMU). 



I • Interactions Within Units 

WIN Sponsor Units 

Staff meetings . Formal office and unit meetings were held routinely in 
nearly all of the sites visited (39). Local WIN sponsor staff usually 
attended general staff meetings held by the office manager, whether WIN was 
located In an ES office, a WIN office or a welfare office. In addition to 
office-wide sessions, WIN unit supervisors also usually held weekly or monthl 
meetings. The frequency of formal 9. .ff meetings reportedly varied from 
dally to yearly but was not associated with performance. The character of 
these meetings, however, was related to performance. Managers in high 
performing WIN sponsor units tended to have flexible agendas and hold open 
discussions. Staff participation was encouraged. In contrast nine of the 
15 low performers had very structured meetings dominated by the supervisor 
or manager with little or no staff participation or discussion* 

Task Interchange . Sponsor units varied considerably in the .degree to which 
tasks of Individual staff were separate, interdependent, or routinely 
exchanged. As indicated in Tablo 32^ staff in high performing offices 
were more likely to assist each other or exchange functions.* They expected 



*There was a correlation of .503, significant at the .01 level, 
between performance and task Interchange. This relationship was found in 
large and small units, and in WIN units located in ES offices as well as 
those that were self-contained • 
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to cover for each other when there was an absence and in many cases were * 
ciosa-tralned. According to staff and managers, exchanging tasks gave 
staff a better understanding of the entire program. In some cases moving, 
staff from Job to Job was also part of their preparation for promotion. 



Tablt) 32 

Loc al WIN Sponsor Staff Task Interchange 

High 
Performing 
... Offices 



^ • Kltfld task structure. 

very little Interchange. 

^* jLl^xl ble staffi ng, some 7 
covering for each other. 



Average Low 

Performing Performing 

Offices Offices Total 

5 II . 16 



1 14 



3* Coope rative interchanp^e > 3 5 2 lO 

cross-trained staff, 

(Insufficient Information) - 2 * 1 "X 
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In contrast, sponsor staff In II of the 15 low performing units 
rarely exchanged tasks and had less knowledge of functions handled by other 
staff. lx\ three low performing offices, staff expressed resentment at having 
to i-over for each 'other and complained abput "having to do someone else's 
work". 



- ^■^nf Uct aiid re solution . In any organization some degree .of conflict Is 
to be expected We were concerned with the ways conflict manifested Itself, 
how It vas re.-,olved and whether patterns of conflict or resolution were 
associated with performance. WIN sponsor staff generally reported smooth 
relationships within their units. Workers In 27 offices (Including all ten 
hUh performers), reported an atmosphere of cooperation with minimal conflict, 
^taff In only nine said that the atmosphere was tense or contentions. In 
•Hlx other offices there was "friendly competition" between Individuals or 
units, usually to maximize numbei of placements. 

Three types of issues caused conflict In WI. sponsor units — 
personality clashes, disputes over procedures, and ten:jlon between manage- 
met L and staff. Staff in only three of the ten high performing units 
reported any conflict, and that was limited to an occasional personality 
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claah. In contrast, staff In 16 of the 18 Xbw'perforaipg offices aa^id 
all three typea of conflict Vera common* . 

"■ . 

» Methods of resolving conflicts were also significantly different 

in high and low performing offices. In high per iforming units, persons 
involved in a conflict would generally 'try to work out the prohlem directly. 
If necessary, a supervisor would "listen to both sides" and seek a resolu- 
tion. Staff in these units emphasized that problems were -not allQwed to 
continue without attempts at conciliation. In seven of the -low performing 
offices, however," staff said that there might be some instances x^ere ^o 
attempt would be made to resolve the difference.* 

Separate Administrative U^nltb 

In the 13 SAU's that had five or more staff , there Vas very Uttle 
variation in how workers interacted. In ^11 but one of the .13 SAU's rela- 
tionships am>ng ^ther staff were reported to ^ very good, with only minimal 
personal conflicts,. In all units visited SAU>€trkej:8 worked independently, 
each having a separate caseload. 

I ^ • . ' > - . ' 

;Three distinct types of^statf meetings were held In SAU's. Super- 
visors conducted regular staff meetings in order to 4istrlbute infomation 
or discuss procedural issues. In many places the meetings also included 
staff woi'king on Title XX, day care or food stamps, if they were all in the 
same unit. In addition many on-site SAU supervisors held case conferences 
with each individual worker. A few supervisors also conducted sessions 
specifically designed tb mbtivate staff. These included role-playing, 
sensitivity training, or v discussions on behavior modification. 

2*. WIN Sponsor-SAU Relationships 

• \ . ■ . ■ ■ 

Sponsor-SAU relation-ships' at the local level were generally reported 

to be good, regardless of performance level, collocation, or program size. 

Ir two-thirds of all the study sites, we were told relations were "quite 

good." s , ' 

Several factors were cited as contributing to problems when they did 
occur. Sponsor and SAU.staff in 17 sites believed there were"professional 



^Performance and conflict resolution were correlated .292, slgni- > 
,f leant at the .01 level, based on staff and super isor responses to written 
questions on methods of conflict resolution. Managers in low performing 
units were more likely to ignore problems or avoid dealing with them. 
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differences of philosophy between them. Sponsor and SAU 8taf| sometlnes 
disagreed on the employabVUty of clients, types of services needed » and , 
\iihen (or if) to begin adjudication. Uaually SAU staff felt sponsor i^taff 
were Insensitive and. harsh toward clients, and sponsor staff thought the 
SAU was "too soft".. In three places, however, the SAU was viewed as being 
stricter with the clients and sponsor staff as being isore concerned «7ith 
helping clients. . . 

."i • . • • • . * . 

In seven sites problems arose between the sponsor and SAU because 
SAU staff felt overburdened by work the sponsor was generating. Six of the 
seven SAU's reported a number of unfilled vacancies* • 

*► • • 

^' Finally, in a few sites uneasy relations centere^i around the SAU's 

desire to 'actually place clients in jobs. In one place the SAU had assumed 

some placement responsibility.* In two other places SAU staff felt the 

sponsor was incompetent an<^ tliat they should be allowed to refer to Jobs 

and training. . ' - . . ^ 

WIN Sponsor'-SAU Interaction 

^ The level of WIN sponsor-SAU interaction at the local level was 
fairly high across the entire sample. In only four of the 43 study sites 
.was there little or no contact between the two staffs. All four were low- 
performing 'programs. In these places requests for and tranmission of 
certifications and other paperwork were handled by mail.* There were no 
joint procedures or joint meetings and only minimal telephone contact. 

As Table 33 indicates, in 19 other programs the main contacts 
between SAU and sponsor staff occurred around procedures that were handled 
Jointly, mainly appraisals and adjudication. . In these sites the SAU had . 
minimal involvement in IMS or orientation sessions, and meetings between 
the. two staffs were rare« 

Fifteen other programs (including eight of the ten high performers) 
had substantially more interaction. There were regular Joint meetings at 
the supervisory level and usually at the. staff level as well. In a few place 
sponsor and SAU staff Jointly counseled clients. ^ Some also Jointly conducted 
home visits and group orientations or had regular monthly case conlerences. 

The type of regular contacts between sponsor and SAU staff was 
positively related to performance.*. In high performing local programs, o 

*Interview data showed a correlation of .409, significant at the 
.01 level » between sponsor-SAU staff interaction and performance. Tills 
was confirmed by staff and supervisor responses to written questions on 
types and frequency of contacts, where a .489 correlation between contacts 
and performance was found, significant at the .01 level* 
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SAU and spon'tor staff %rere more likely to have regular aeetinga* dlteuaa 
progvaM laauta and confer often on individual ca.aaa« Staff typically had - 
procedures for coordinating functions and dally work-related oral and written 
contact* * .v. • . . 
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. High * Average 
. . Performing Perfomiing 
• . Offices Offices 


Low 

O A VMM 4 n A 

irercorniXug 
Offices * 


Total 


1. 


Minimal Interaction (separate 
functions t no meetings) #• 




4 

3- 


4 

• 


2. 


# 

Procedural interaction (Ibflnly 
Joint appraisals). 


1 10 




19 


3. 


Extensive interaction* 


8 6 • 


1 


- 15. 


(Insufficient Informatlou) 


1 . • 1 


3 

• 


^5 
43 
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3*. Interactions with the ES and IMU's 







This section dealk with the interaction between WIN and local 
employment service and Income maintenance un:^ts* The WIN Handbook and other 
federal guidance treat these relationships as second in Importance only to 
links between the WIN sponsor and SAU* The ES and IMU are central elements 
of host ageticles and- potentiality important contributors to WIN of information » 
expertise and clients* It is reasonable to expect that the nature of WIN 
linkages to these units might affect local WIN operations and performance* 
We treat fiS links first, examining the nature and Intensity of interacferions, • 
resource exchanges* WIN accesp to ES job orders, and the character of ES-WIN 
relations* 

• » 
The Eaolovment Service . • 

Extent of Interaction . Interactions with the ES were more limited than 
expected. Aa Table 34 indicates, there was only minimal contact between 
WIN and ES units Iri 28 of the 43 study sites* In most of these places (16) 
the only regular, work-related Interaction was the use of ES Job Bank* In 
the others some contacts occurred due to WIN-ES collocation or relationships 
between individual staff, but these were limited or sporadlfc. 
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In 15 Biteft lAtetac^'ion va» mote exten»lve. Contact around specific 
functions occur^ired ii^^elght of-^heta. In soma offices It was standard ^ 
OiMratlng |^ro6#^iif|,,;;^^^^^^^^^ use the Ed's bilingual interviewers ot its 

testing materials, 'th c^l^er offices the services of single counselor would 
be shared, or WIN and Ej|;!«dunselor8 would come to each' other's assistance 
during temporary workload >i;|>crease8. Elsewhere WIN job developerii and ES ' 
employer representatives >^^ld coordinate their employer visits or occasion-, 
ally swap leads and Job 'mha they could not use. " 

In only flv<$ placka were WIN and ES activities, highly coordinated. ' 
Here WIN and ES staff made Joint visits to employers or were trained to 
provide employers-wlth Information on each other's programs. Job orders and 
leads were openly shared. WIN staff would cover for ES staff when they were 
absent, arid visa versa. Formal cross-training sometimes occurred. All five- 
of t^ese sites were in states where the SESA leadership perceived WIN as • 



Table 34. , - 

Local Wiy-ES Interactions • 

High Average Low , 
. . Peiformers Performers Performers ■ Total 

k ^^^^^^^^ 

1. No contact except Job 'Bank. 2 7 7 16 

2. tontacts, but kept to a minimumV 2 6 4 12 
,3. Contacts on specific functions. 3 3 4 10 
4. High degree of coordination. 3 '2 0 .5 
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"important" or dt least treated it equitably. In all five WIN was Integrated 
into the ES chlin-of-command , and the Ideal ES manager gave 'high priority to 
WIN. As Table 34 shows, three of the five WIN units were high perfqrmers. 
However, the other interaction categories Indicate no clear pattetn of 
association with performance. 

Resource exchanges . As suggested above, reciprocal exchanges of resources 
do occur between some local WIN and ES units. The prevailing pattern, 
however, was either the absence of resource^xchanges or the diversion of 
some WIN resources to other purposes. In 21 local sites t\9 past or present ' 
resource diversions were reported. In 19 others various types of diversion 
(e.g. using WIN staff on ES or CETA work, dumping ES- staff Into WIN, and 
using^WIN for patronage) either were occurring or had occurred in the past. 
In three sites WIN staff were occasionally used for ES activities but were 
covered by ES funds. 
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Four of Che five sites ^ere VIM staff were used to . supplement CETA 
re<iources were in « etete whece WIN wes adniAilitered tlur6^gh the ES chein* 
of«-eonnand, and the 'SBSA had ^ut top priority on CETA* Local tS ft^nagefrs 
reaponded Jay assigning as nany local staff to CETA activities as needed* *- 
Staff assigned to WIN were more *of ten working on CETA registration and -* 
referral than on WIN. In contrast all five of the offices where WIN-ES 
resource o^changes were reciprocal were also in SESA's that ran WIK througl> 
the ES hierarchy* However, these SESA's were neither .hostile nor predatory s 
toward WINr and this was reflected in' the higher prd.ority the program « 

received from many local ES managers* , " . / 

.» . • ' ' ' . , 

Resource diversion appeared somewhat less frequent in.^high performing 
units, currently occurring In only two of ten*. Qpnversely, curi^ent diversions 
were reported in ten out Of ,15 low performing iu?lts* 

. ■ i 

Access to ES job orders * - A major rationale .for assigning WIN sponsorship 
to SESA's was the expectation that a^cc^ss to the employment service's Job 
orders and referral mechanisms would be crucial to'^WIN** However, as Table 
35 shows, in nearly half of the local sites visited-,* staf^ claimed to us^ 
the ES Job Bank very little. They reported that openings listed in the Job 
Bank were often €.illed by the ES before even being placed in the Bank and 
that many job orders were old and outdated* WIN staff also frequently said 
it was difficult to place their clients in many of the Jobs listed because 
they required skills, experience or transportation that welfare recipients 
rarely had* . . 



^^-ralDle 35 

WIN Access to ES Job Orders 

..y .. — — ^— — — ^— 

■High Average Low Tot^sil 

Performers Performers Performers 

Is Minimal use of Job Bank 3 ' 8 8 20 

or ES orders* 



2e Job Bank and perhaps occasional 0 3 1 4 

priority for referral to "real" 
^ Job openings* 

3* Job Bank, plus some job leads or 2 3 4 9 

copies of orders* 

4** Job Bank, plus^ copies of all 3 2 1 6 

orders or open job order box* 

5* Same as '•3", plus ES approaches 2 2 0 4_ 

WIN with Job leads and ES employer 

reps promote WIN with employers* 43 
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. ■ » . . ■, .... -.-.'jife-. 

<^ V As Tabl<? *35 indicates, job orders or leads vere freely shared 
in bnly^about one-qtiarter of tlie study sites (10) * Fiv« of these %iere 

. high* perfomlng offices. S6me reluctance la understandabU^ glv^n the * 
importance of Job orders to the ES» whose funding was more heavily depen- 
dent on placement performance than WIN's. However, this reluctance 'may 
have been compounded where (1) Vl^ had low^ priority within the SESA, 

;<2) the ES- feared that employers react adversely to .welfare referrals, 
(3) job orders were tight, (4) interaction between ES and- WIN staff was 
Infrequent, and (5) ES staff were not knowledgeable about WIN. -M 

Because .04 'access problems and the difficulty of matching welfare ^ 
recipients ,wlth the requirements, in many ES job orders, WIN staff found those 
orders only marginally helpful. They tended to rely to a surprising degree 
on other sources of Job openings for their clients.** 

WIN-ES r elations . As the above discussion implies^ the relationship between 
local WIN units and the ES vai;ied dramatically across our sample; In about 
half of the study sites X21), relationships were negative, tense. and compe- *. 
titlve. In another ten, there were neutral or "mixed" relattlonships or no 
contacts at all betweien the two staffs. * 

, In the 12 remaining study sites relationships were, to varying degrees, 
'cordial, supportive or cooperative. In three of the^e sites, while the rela- " 
tlo^nshlps were cordial, the ES frequently used WIN staff for CETA activities 
charging CETA time to the mm budget. Six others were' in small towns where, 
^close Interpersonal relationships had developed over the years between ES 
and WIN staff collocated in the same small office. Importantly, eight of 
these 12 units were In states where SESA leaders' attitudes toward WI^N were ' 
supportive. By contrast only one of 16 sample units whei^e state agency 
leadership was hostile to WIN 'reported supportive local links wit^ the ES. 

Tiie data presented here raises an important question about WIN's 
organizational affiliations. In; the past SESA's have been designated as 
WIN sponsors almost automatically. But, if WiS-ES contacts, are usually » 
mlntmal, if WIN reliance on ES Job\ Banks and Job orders is limited, and if 
relationships are often hostile, might other sponsors not be considered in * 
some cases? The answer seems to be "yes", provided that "they have "access 
to the capabilities WIN needsv thatllare usually most extensively available 



I 



1 



*It should not b« assumed that WIN only draws on a 'Job Bank without 
making significant contributions to it or thaC'WIN placements are always 
Into lower quality jobs than ES. In one major city in our sample, about 60% 
of the listings in the Job Bank were developed by WIN staff. In another the 
average wage level , of WIN placements wab higher than ES placements, and ES 
staff often tried to refer to jobs developed by WIN. 
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,in SES^s* These include Intimacy with l«b(>jr nerket infotaatibn and ■ 
v«xp«rn«* in Sob deveXopttent* job tearch coun>eUii| and iii^plicant-^40b 
matching. The one itate in our eanple thit had ttiiniferrid ldd4l 1rtN apdiiaor 
functions out of the SESA had also transferred many experienced^ staff as 
.'well* 

Inyoyte Maintenance Units (IMU) 

* ' • 

Many facets of WIN involve information; and work flows b4tween MIN 
and IMU staff.. WIN stiff must rely on IMU staff to screen, and/ refer 
potential WIN registrants. WIN staff need information from the IMU on status 
changes of clients that range from new addresses to changes ifi family composi- 
tion, eligibility and grant '^size. Two items used in WIN perfdrmance 
.measures— obtained employment* and welfare grant reductions— riely heavily on ^ 
data from iHU's. Breakdowns in coordination can- lead a lodalj WIN unit to 
imderrcpo'rb activity on these items, adversely affecting its /state's 
, perform^nce'''and federal fimding. ■ . 

The relationship with ineome maintenance units was troublesome for 
most local WIN programs in our sample. In only fitne veve relations cordial 
Old supportive* and coorditvation problems temporary or infrequent. Ino24 
£kttes 'paper or information flow problems were constant., and. relatlonshipa 
were often distant or hostile.. 

t 

• ■ ■ ■ I 

The nine Ipcal program? that had smooth coordination f it„ into two 
main categories. Four were in a state where the welfare department admin- 
istered WIN. IMU' severe houseji in the same buildings as WIN and reported 
f to the same manager. ..Four WIN 'units'*' in, other states^had an JMU staff pers'iSh . 
or unit collocated. While delays, misunderstandings and animosity still 
afflicted relations betweian these four WIN units and IMU Staff elsewhere, 
coordination with the oitptfite eligibility, workers was good. Orily one local 
program in our sample was able to develop a highly effective coor^din^ted 
relationship with the IMU without sprae form of collocation. ^ 

1 " • ^ „ «■ \ 

Although coordination problems existed in nearly all ^ites ^visited, 
sponsor staff in high performing WIN units tended to have more frequent v./' 
contact with the IMU (telephone, written communicatio|is, meetings) thaji 
staff in low. performing units. We fOund a correlation of '.37, significant 
at the .01 .level, between perf,ormance and frequency of contacts with IMU, 
\ based on staff responses to wr,itten q^uestions* , * , 

Problems in. the WIN-IMU linkage are not surprising. WIN is a low 
priority for an IMU worker. Its paperwork constitutes a very small portion 
of his or her job. Tasks in the IMU are extremely routinized, and the 
workload, on IHU personnel is quite heevy, particularly in urban areas. In 
.communities with large welfare populations, the IMU is often overloaded 
%ri.th routine address changes, grant^tlons, ^nd updating ^kase files. 
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At the^s«me, time the .putvltlve 9S{{eet8 o£ ca«e tttiinageiBent Aiid the financial 
respoifeibi^^lty asaociated with grant calculation can'ginerate jgotidna^ 
priaiuiri^* .' Job Clavaificatibna ahd^ipay ««i ;uau4iiy ibwv iahi) ttiitnb^ir i# 
high.. Many respondents referred to It as "the woifet^ob in welfare'!* 

' ', "* . . ' " ■ 

In most urban sites not' only was IMU s^aff turnover especial4y high, 
but also* training for new staff was often minimal* Even where staff .jtraini]ig 
did exist, it soiiietimes did not occur often enough to keep^pace with turnbv^r 
nor cover VUN procedures and forms. For all of these Reasons it was very 
difficult fgr WIN staf? to successfully coordinate with IMU's*. 
•* • ' ■ • . . . ■ • ■ • • 

In evjpry local WIN- office we visited, staff and management vieve 
aware of this IMU coordination problem. In some places we *found that steps ' 
were being taken to improve "interaction and communication. WIN-IMU collor 
cation has already. been mentioned and seemed to alleviate coordination 
problems, especially in large urban programs. In many metropolitan areas 
therje are several income maintenance units, e«[ch responsible for cas^s in a 
specified geographic zone. WIN staff must deal with each one. Cofieolidating 
all WIN cases in a metropolitan area into the one IMU located in the. same 
office as WIN appeared to improve work and information flows 'between/tlve 
staffs* • ■ " . 

Other techniques that were reportedly helpful included: 

• Meetings of WIN sponsot, SAU and IMU supervisors. ■ * * 
' These wer^e 'either regularly scheduled or occurred 

only when problems arose. Even an initial meeting 
to start a diaifpgue. often proved sal.utary by sensi-' , 
tlzlng IMU persbttnel- to. WII}, about which the^ often - 
'knew little. • „ ' I 



• Presentations by SAU or WIN sponsor staff to local 
IMU staff on WIN objectives 'and procedures, the 

„ services it offers-, and the i^po^tance of the IMU^ 
to the 'program. « ■ / , «^ 

• using WIN fiends to train local iMu staff on WIN 
procedures' and object Ives, --feme times jointly with 
sponsor and SAU stalf. 

• Assignment of a'staff person $ In the, state welfare 
department to serve as a liaison between the SAU 

' and IMU and resolve Coordination and reporting 
problems* ^ / ^ .9 

• Develotunent by state SAU and other welfare staff 
of an automated reporting system for local welfare 
departments* This was Intended to i^educe \the 

^amount of paperwork required of IMU staff,; leading 
to faster, more accurate Information exchatiges 
jSetween IMU's and WIN units # V 
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Now we turn to relationships between local WIN units, aiyd programs 
or organisations which lie 'outside the host agencies. These Include CETA,. 
vocatio^gil rehabilitation, educational instltutlond, and other community- " 
based organizations or agencies., 'Particular attention is^paW to CEtA for 
two reasphs. First, in, many copmunitles CETA is by far tlie largest local . 
employments and training program. As such, it is a potenttal .soi^rce of , ^ 
're^sources for other, less resource-rich programs, such 'as WIN. Thus, t.he 
acquisition of CETA training and public service employment (PSE) resourdes 
might importantly influence the 'effectiveness off local' WIN programs. Secbitd, 
some welfare reform proposals would give CETA prime sponsors responsibility . 
for the' population now served by WIN. Knowledge of the CETA-WIN relationship 
should be'useful in assessing the feasibility o.f thos^ prppoffale or^antlcl- / 
patlng problems In implementing them. / i * ' 

\\/C8 chapter provides .answer^ to the 'following questions: 

% / , 

To ''what extent dide^lotal. WIN units develop relltl9nships . 
with other local agencies? 

^« What fa^^tcrs appeared' to affect the presence, ^abse.nce and 

, intensi'ty of these, relationships? v . 

•/•.-..> . ' ... 

• Did these, interagency linkages have any' effect on local 
WIN program perfqrmance? 

We define interprogram relationship as the type and" amount of inter- 
action that occurs between programs.^ To what extent does a program augment 
fts resources by , obtaining services for its cl;lent8' froni other programs? 
What proportion <^f its clients ^are jointly served by other programs? flow 
much and what kind of information, flows between it and other programs? 
What is the nature and extent of ijta contacts with these programs? 
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' ^ * ' \ . ■ • ■ , . • , ^ . .' 

" theoretically, V^I» » irelntibniihip *iiith CETA prtme sponibrs f^hbuid v 
be Its most <mpoi;tant linkage outside Its host agencies. WIN has relatively ' 
few Internal rfiaources to use in upgrading the skilljS, of • Its teglstrants. 
Therefore „ the legist emplpyable 'individuals in its "tegistrant pool either 
wait in the queue for. limited WIN training and PSE, receive .minimal attention 
as "unassigned", registrants, or are referred to programso like C^tA for traln- 
'Ing or PSE placement. CETA PSE positions could conceivably provide WIN regis* 
, trants with opportunities for transitioning into ^ permanent public sector '• 
Job or for Improving their job skiUs, employment records and, thus, their 
chpces'ln the private job market* Similarly, CETA training programs might- 
augment limited WtN training resources and, thereby, help WIN registrants 
to compete successfully for private sec tor^ employment-. \ - 

Our knowledge , of WIN and CETA programs led . us to suspect that their 
relationship might be highly asymmetric. Local WIN and CETA programs were 
unlikely "to be equally dependent on each other for resources or information. . 
CETA had three types of xesources WIN might want— training for WIN clients, 
, PSE jobs for WIN clients, and CETA-funded positions to be used In WIN offices. 
.Prime sponsors on the other hand had few resource needs fro^ WIN^ They rarely 
needed appll^sants^ from WIN, since they^ usually had far too mahy applicants 
for their available training, and PSE 0](>eningSr Although a prime sponsor , • 
might seek WIN's help in obtaining ma« welfare applicants to meet a federal 
guideline or to achieve their own flfoal^ for welfare recipients/ participating, 
in their programs, it^seemed reaso^bl4 to expect that prime sponsors 
general! y\ would be far 'less dependei^tfon WIN for refojurces than visa versa... ... 

Furthermore, while CETA appeared likely. to need little information 
from WIN, WIN ^taf f "were probablyodependent on the prime sponsor or its 
aubgrante^s for several .important types of Information. These included ; ; . " 
Information on (I). CETA job and training openings, (2) the disposition ' 
of WIN clients' ■applications to CETA, and^ (3) the status of WIN. clients 
accepted Into various CETA components. . r, 

* ■ . • • * . 

However, there, was also some reason to hypothesize that prfme sponsor-s ■ 
might encourage linkage^ with WIN. One of CETA's purposes is to develop a' 
coordinatlve and comprehensive local .service. delivery system, bringing • ' 
together local employment and training resources an efficient, non- 
duplicatlvc manner, this' presumes that CETA prime sponsors would develop 
dialogues, linkages and joint activities with other local programs. To the 
extent that prime spon^ibr^ attempted to do this, one would expect more 
frequent contacts between local CETA and WIN programs. . The Initiative was 
.clearly with prime sponsors since they cbntrolled the tiulk of local resources. 
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ittt^ ttie pbllcy of) who would i^t^lciplij 



^-A? / _ __ ^ ^ 



l^e foUoving si^ct^s' focus. an |our areas:. 
• WIN access to CETAr^reaources. 
. f • vilN-CETA coatac;li'«nd *ln£ormatlOtt flows."' 





^' '•. WIN par tic io/t Ion local, cpft systems; ^ 
' • ' '■ ' / ' "- • ■ 

Factors affecting' the CETA-WIN relationship. - . 

• ■■■/.■-■■.;.'.■' ■ ». ■ ■ • • , ■ . 

WIN access to GETA resources , . ' * / 

rr; ; ■ ^ y L ■ ^' , - " 

' ^ Wll^;atid. CETA staff were ^dlced '^or information abput WIN'e aeceas! \ 

■ 'to three kinds of CETA resources: CETA-funded positiona for WIN units, 
(^iTA-funde^^raining ' .r WIN clients,, and ,PSp jobs for,WtN regjistr^nts 

un-'er bot^ Titflps lI .d VI of the^ qompretiensive E»pJoyment and Trainitfe ^ • = 

■CETAylunded positions in WIN uni^s . ■ Less 'than'one-third (13) of the .A3 
' locil WIN programs visited reported -hdviiig some CETA-futfded staff.. 
.vG^^ralJy, this Involved iane <jt. two 'tnd£v|.4ualsi In mos^ases they per- 
. /formed^, Clerical 'tasks in the WI»7 sponsor, unit or served .as "(jaae aides". in, 
/ -the ?AU,\ But in several slter they had reapoxfftibillty for referral and ' / * 
eligibility determination/a id ii» a few ptheirs tliey served as ^^'r^gular W;n / 
ataff**; \Anal,y8ls reVealed no pdtterns .associitiifc the presence of CETA-. 
funded poWit ions in local WIN unit ft' with 'unit perlormance, 'Size, state 
identity, \or urb^5iii-riiral location. . : ». \ ^ . .\ , • o 

■ \ : N ■ ^ ■ « * * 
Access to- CETA-funded training ; WIN^acceris-to- CET^-funded training appeared ^ 

. generally ,4uite limited", lii about half (21)' of our '43 loqal sites ? percent 
or less of^he WIN caseload was reported . to, ha^e obtikln«d entry to GETA ^ . * 
Title r Inst itutiorial training cqmjjotjents.. In another i'6 sites apptoxiirfat^y 
6-20 perceni of cWIN registrant a were reportedly "in CETA-funded training slots. 

... . "V ' ■ ■ . ■ 

; '*Becal»8e' our. field work octurred^prior to the reauthorization of 
. CETA in l?£e 1978, reference^; to PSE will be related to pre-1979 Titl'es II ; 
/ and VI programs-. The reauthorization •lfd.<|p some major revisions in CETA. 
■\ Three of the most important cljang^s werr (1) re-emphasis of tta.ining with 

i,ncreased ^f^mdsy (2) decreased funds' for PBE, and (3.) tightened eligibility 
, tli^s.fOT Vll programs "so that the most^ econoinicaliy- disadvantaged receive , . 
service priority* - : ; ' 
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c^fr ^ *n "«*y vuir« aw. ff^orav or TespoRSQii eupg««i; more cnpn *<i;^i\j 

^^^H ^ lliipgg ^*|r6 Will Dttiit thatrftad, ^tlon"^ T ^^tu^ ixid fimM : / , f | « 

- vith the CETA-ffunded sUli Jclettterit The- vunte» had been founded during WlS^It . J^^^ 



•*4 * 



largely witlj WIN . f undar.. ^ Word was jiasaed' that WIN was ifelcdih'e to refaf >^ 
clients directly .tq the akijl'^ center, bypaa^iJig^he ptl»e sponsor 'a regulals . f, 
^relerral jprciQedUrea^;^ ,,. .. .J^;. . ■ ; , . .v;"..., ...'z . 

/ . * 'Tha other two'-'sltea^, dne urban and one'rural, »ere in the saiais aoall . Wti 



A State. In ttia, urban site the-m^yQr 'topic the posture' that CETA.was o^t of 
bounds to politics and" d-elega ted all bperdt'i^g deai8i9ns t* the' staff. That 
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WW HVAAb^tiB «inu ^exegAcea operaci^g aieaxsi9nB co- cne SGatz* mat • / -.m: 
Staff actively pur$ugd~thi[ lnteres|:s of disadvantaged tiarget grsupa* in \ their J , % 
^ dealings with service dell,verers and^their allotation of P^B slots ^ a rardty '"^ -."'^^^ 
in our sample. ''Records showed that 27 percent of 5eta pairticlpaftts in i^ieti- * ^^/| 
tutional training were APDC recipients. At the rural^ site the •SAU played - V # 
the key role. Mvich of th^ institutional training in this stata was provided , \; * /| 
through a single central facility managed by the st^ff of the governor's * j / i 
manpower office. Dufing start-up of the facility, CETi(^ staff had. operated. * " ] 
out of ^the SAU's bffic.e. The rappdrt thus established between t|he SAU and '. 
CEXA Icontimied t6 permit a substantial number of WIN clients to get i^ito * \ 

the training ce^nter. . However , -this Was the bnly dlte lln our sampll with ■ >k 



a substantial CET^-SAU linkage*. '■ ^ ' . f . ' / IW 

k.\ ■ . - • \ -i . ■ 

i ' \ - Interview re^nsels pr6vided reasons why WIN pArticipatloh*'|^i CETA* / /.'': 

'». ■ ^ / training waa vgenerally>llmlted^. ' Table' 36 li'sts some of them , in the 70m . /' | V 

• of the explanations offered by WIN and CETX local staff. The degree to V / ,vc^^« 



\ 



*While WIN reporting -system data and staff perceptions' were -the prlmajry./ 

source fo'r information on access to CETA. training, we also obtained data *roffi / 

CETA prime alpdnsor staff where feasible^ These 'were used to c'orrobOrate WIN / 

«t information sourpes. • Our judgment was that if 5 percent or leas of' ciSTA's j 

tiiaining 'slots were filled by AFDC recipients, this was* roughly comparable ^o. 7 

tha "5 percent or i^ess of WIN caseloads" data jused above. This ^as assumed /, 

, ' ' for the othei- percehtag-e ranges -fs" well. . " . ' / 



\ 
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which/thest attitudes were hel4 varied among sites and even among r'espon- 
deiite In * the sai^e local. unitts» Hoyevcr, the. cumulative «£,£ec*t of the views ^; 
'exprttssed by bb^h'Wtti an4^0ETiKi {^erionnel help explain' tihe general situation 
that we found** Analysis revealed no association between access to CETA 
'training and local* WIN unit performance* ^ 
- V * ^ * ■ ■ ■ . . 



Table 36 ' 

Beaaons Given for Lack of WIN Participation 
In CETA Training 



t By VtW PwonntI * By^ETA Ftraonnal 

• ' l« Training !• w A Wilt priority* AFDC rteipitntc art not glvin oiicaptioMl pilov* . 

ity undtr Titlt t. 

. 2i Tha training providad la poor quolityt S ^ ' \ ^ 

; , "2, viN cUtnta. can't »t«t tha tralnfni antrajica cf 

\ « )« Tha tralntnn la poorly targetaj.^ Thar^ art ' * qulcaftanta, for eKa»pla» Cor nuraaa, 

. « . ' • nq iobn litro in thoaa llaUa* 

^ ' ^ . - \ / 3« 7^«y Ata mora dlCllcuIt and hava lovar auccaaa 

4* tUa Wnlt la too longs advaraaly aCfaetlng Tataa. 

^ur eilma* attltudta and habita* ' « v 

4t WIN rafara thalr elianta too alowlyt tha aXota art 
S* ' Acceaa la Xinlilttly dut to era««lng by tha * aU* fillad* 
: * «^ prime or tha aervlea dalivarar^ * ^* 

' ' . ' ) ■ 3« VXN d >aa not aand ua thalr baat ^lUntid. 

^ $• Tltay h.tva tw Canalforlantad couriaa» ;iind 

h our oMperlanea hare with non-traditional 6, Wa hava fav training dlota, and daaand for thaa !• 

» . ^Jobi» lor wo«an .haa bean bad* \ '* high. - * 

^ ^ . Wa rri'tvr .OJT or vork axpariancai tlaaa* WIN haa ita own raaoureaai 

fAoia training io oCtcn unraaliatie nnd ^ . 

irrolevant. . B. Waitara raoipianta lank vlll or capacity. 

f • Vb iMva enough, traininr tunda of our.own* 9. Va won't daal- vith WZM^ (or tho ES)^ pariod. 

^ 9» jCont'^ct is loat with elianta whan thay ara < ' 

"aun|ii»n>iad** to CBTA, . • * \ 

10« You n«t^W> placanent cradit tor rafarrihg a o 
. ^ ' client to CSTA gaining* 

. 11* t won't deal with CETAi period* 



fl"' *Sotne state-to-state variance was observable. For example, in ^ 

the state with a welfare-run WIN program; the argument that "training was 
.not a WIN priority", was, t^aken particularly seriously. Local WIN 8t;aff 
tended to i&pore whatever CETA training possibilities were available. 
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Acceas to CETA PSE. Our findings on WIN access co CETA PSE were not surprising 
given the target population for PSE suggested by the language of the Comprehen- 
alve Baployment and Training Act of 1973. The Act only stipulated thlit 

consideration" should be given to thosie most disadvantaged. Creation of 
the Title VI PSE ptogram in 1974 strengthened the word "consideration" to 

preferred consideration" in regard to the participation of disadvantaged 
workers. The CETA amendments of 1976 however required that most Title VI 
project participants be long-term, low-income unemployed or welfare reci- 
pients Thus, there should have been increased participation of WIN regis- ' 
trants in this pSE component. j ' 

The data collected in our sample of 43 local sites in 1977-78 showed " 
that WIN participation was more extensive in Title VI than Titl^-II but that 
Title VI participation also remained negliglJjle in a large proportion of 
localities. Records and interviews indicated that in 59 percent. of our iit^a 
there was little or no WIN (or AFDC) participation in Title 11. There was 
/also little or no access to Title VI PSE in 35 percent'of our sites. Table 
37 summarizes our findings.* Analysis revealed no significant association 
between access to CETA PSE positions and local WIN program performance. 



Table. 37 . i - 

WIN Access to CETA PSE 

* • . 

Inadequate or 

. A lo't * Some * Little or none * conflicting data 
Title II 4 12 ' 23 . 4 ' 

Title VI l"3 , i; ' « 15 ' 0 ' . ,/ 



*"A lot" was defined as more than 20% of either (a) the total 
number of PSE job holders who ha=d been AFDC recipients' or (b) the active 
WIN caseload In CETA PSE»- as reported in progtam records or research inter- 
views. "Some" meant between 6^20% «f either (a) or (b) . "Little or none" 
was 5% or less of either (a) or (b) . 



*In the remaining portions of this section 5fe will limit our con- 
sideration of PSE to Title VI positions only, for- two reasons. First, 
Title VI had significantly larger resources and- numbers of PSE slots than 
Ticie rr. Second, given the explicit target populatl«bn status of welfare 
recipients in Title VI, it was a better gauge of CETA prime sponsor priori-' 
tizing of services to them. - * . 
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Information Flows, Between CETA and WIN 

Information flow^ between CETA and WIN varied greatly. Data were 
collected from local WIN and CETA personnel on the frequency of meetings, 
telephone conversations and other Informal contacts between the two- staffs. 
WIN personnel were also asked about the timeliness, accuracy and complete- 
ness of information from CETA- on job or training opportunities, the status 
of WIN registrants in suspense to CETA, and CETA procedures or structure* 

In 15 of our 43 sites contacts of various kinds were frequent, and 
WIN staff reported no problems getting the information they wanted on CETA 
opportunities or client status. Local CETA and WIN personnel In ten of these 
were. In effect, collocated. ES staff under contract to CETA worked In the 
same office as WIN personnel. These were usually small offices in 'small * 
towns. Thus, the ES staff responsible for WIN and. CETA often viewed each 
other as co-workers, friends and neighbors. In the other five sites CETA 
and WIN were physically and organizationally separate, but staff reported 
either meetings or informal face-to-face contacts at least several times 
a month, and telephone conversations occurred nearly dally. Several .of them 
reported t:hat consultation between WIN and CETA* staff about Jjidiv^ldual cllenifr- 
was common practice. There was no repoirted difficulty tracking- WIN clients 
In CETA components In any of. these sites, and notices pf PSE openings were 
received early enough to give WIN registrants a genuine opportunity at those ' 
jobs. . ' . - * 

In 31 percent of the sites for which we had reliable data. Information 
flows were reported to be very Inadequate, and contact was minimal. WIN and 
-CETA personnel could remember no recent meetings, and Informal discussions 
between Individual staff members were also very rare. WIN personnel reported 
that contact was a one-way process, always Initiated by WIN and never by CETA 
staff. Even so, WIN staff said they had extreme difficulty getting Informa- 
tion on clients In suspense to CETA, and some staff admitted that they had 
given up trying. This was attributed both to problems In CETA's client track-\ 
Ing and data systems and to prime sponsor staff's reluctance to cooperate. 
WIN personnel reported that announcements about PSE. jobs or training classes 
almost always arrived too late If at all. 

In the remaining 12 sites the situation fell between these extremes. 
In several the Intensity of contact was generally moderate,, and the quality 
of all types of CETA Information was reportedly ;medlocre. Thus, face-to-face 
contacts occurred perhaps once every month of two. Client status Information 
was a problem sometimes, and Information on CETA openings varied In timeliness. 
In the rest of these sites, some types of Information flow were smooth, while 
others were problematic. Typically, WIN staff reported receiving good 
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Information on job and training opportunities but had problems getting 
feedback on client status^ . 

« 

Analysis revealed no systematic relationship between WIN unit per- 
formance and CETA-WIN' Information flows. Nbt surprlolngly/^there -was a 
poiltlve relationship between the reported Intensity and quality of infor- 
in^tlon flows and WIN ac '.ess to CETA PSfi.*!^' 



WIN Participation In CETA^Syatems 



c 



As previously mentioned, the CETA-*WIN relationship might Involve 
participation in (l)/the development of local CETA plans (2) decision^ 
making on the mix of services to be provided by CETA, or (3) efforts to 
coordinate the activities of different local employment and training 
programs. Formal Involvement in local CETA programs usually meant 'either 
the provision of CETA services under subcontract to the prime sponsor or 
membership on Manpower Planning Councils (MPC)« 

We ^ound iio incidence of WIN units formally providing services 
under subcontract to the prime sponsor WIN participation in CETA Manpoveir 
Planning Councils (MPC) was also relatively rare, being reported in only 
seven of A3 study sites* In two cases the SA^ manager was on the MPC, and 
in a third the WIN sponsor supervisor was* The state WIN coordinator was 
on the advisory council to a major city-county consortium that covered three 
of our study sites, and in one site WIN staff served on a special selection 
committee that decided eligibility criteria for participation 



*WIN access to Title VI PSE correlated .64, significant at the .01 
level, with intensity of lAformation flow as described above. ^ 

-^A^Howeyer, in one state A^ere the SESA served in effect, as the 
CETA prime sponsor for much of the state ^ WIN staff Were actually spending 
far more time on CETA responsibilities than on WIN. This role for WIN in 
CETA was determined, of course, by the SESA rather than a local prime 
sponsor* It involved the only incidents in our sample where substantial 
WIN resources were currently flowing into CETA (see Chapter 3)* ^The 
ftltuation in that state seemed similar to. what had happened in the only *. , 
two localities to date where responsibility for* actually running WIN had | 
b€ien delegated tp local prime sponsors* According to federal reports and] 
the recollections of participants, in both sites WlN staff were extensively 
diverted to non-WIN functions, the separa^te idisntity of the program became 
blurred; and services to WIN registrants decli^ned* Both of these experi-| 
ments were terminated prior to our study* 



/ 
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*ln CETA service components* The lack of WIN Involvement on KPC's may be 
of little consequence to WIN. Past studies of CETA have shown that in 
moat cases MFC's play llttl^e role in actual 4ecl8i6n«a9kin8 

Factors Affecting CETA«WIN Relationships , , 

* • • . 

Analysis of interview data indicated that five factors appeared to 
have an Influence on overall CETA-WIW relationships (as reflected by WIN 
access to CETA resources and CETA-WI{1 information flows) . These were 
(l)the CETA intake' and referral process, (2) local CETA prime sponsor policy 
toward WIN, (3). the degree of fiscal substitution, politicization or mal- 
feasance reported in the prime sponsor, (4) the policy of the WIN or SESA 
central office toward CETA, and (5) local WIN staff perceptions of the value 
of CETA services. 

CET A Intake and referral mechanisms . Tlie flow charts in Figure 11 show 
in simplified form the paths by whleh WIN clients might enter a CETA PSE 
or training slot in our A3 study sites. I.n the few type A si"tes in our 
sample (3 sites), WIN was able to refer its clients directly to the^ traih- 
ing facility or the agency that had been allocated a PSE slot without ^ 
se.nding them through some CETA-wtde intake an^ referral mechanism. Clients 
In Type B sites were sent to an ES unit or worker responsible for all 
intake and referral under contract from CETA. In Type C sites CETA intake 
and referral*was performed by a mix ofe ES personnel, local CETA staff and 
sometimes others. CETA In.take and referral were conducted by CETA' s own , 
staff in Type D sites, and Type E sites involved a three-sta^ge process — a 
WIN referral to an ES unit or counselor, an ES referral to CETA, and then 
a CETA referral to a Job or training. 

Ttpw a (3 ttltftt) • ^ • 




TTPt D qZ »Uts) 




' Figure 11 

WtN Client Flows into CE TA Jobs and Training 



*Mirengoff and Rindler (1978). 
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Analysis uncovered 9 strong association (r » .52, significant at 
the .01 level) between the type of CETA intake and referral liiechanism and 
WIN access to Title VI PSE* Those Intake Qechanlsms that we^e more direct 
or Involved personnel closer organizationally to WIN (Types Aiand B) tended 
to be more productive for WIN thdn the others. The fact that^about -half 
the 19 »Typt» 3 sites involved small WIN units that were located in the same 
ES office as the ES staff' doing CETA intdke and referral undoubtedly also . 
helped, since long-standing, close relationships were often reported between 

these individuals* . ' 

\ 

(!» ■■' 

Reported fiscal substitution, pollticization or malfeasance . Some degree 
of fiscal substitution, pollticizationor malfeasance in local 'CETA opera- 
tions was reported in 34 of the 40 sites for whii^h data were available.* 
In 14 cases it was reported to be extensitve. Most frequently mentioned 
(34 sites) was some form'of substitution, the use of PSE funds or workers 
to replace non-federal funds or regular staff. Substitution not only 
violates federal malntenance-of-'ef fort provisions, but it also has serious 
implications for WIN. It leads to the' cstabllshtoent of high skill and 
experience requirements for PSE Jobs. That, in turn, results in creaming 
of the applicant pool to fill those Jobs.' Both work to the disadvantage 
of WIN clients. Other forms o^ reported politiclzation or corruption 
included use of PSE slots for political patronage (at least 19 sites), 
nepotism and favoritism (at least 17 sites), outright fraud or malfeasance 
(at least 3 sites) , and politically influenced choices o'f ser^/ice deliverers 
or 'Sub-grantee organizations. . ' 

An Inverse, relationship .( r - -.415, slgnific;ant at the .01 level) 
was found between WIN access to Title .-VI PSE and reported improprieties 
in local c£TA programs. WIN tended to get less "help from CETA where CETA 
was reportedly more politicized or corrupt .' This seems logical; if more 
PSE positions are allocated to "friends" or "^aiies," less will be available 
for others. , '■ 

WIN or state ES central office policy , tocal staff attitudes often 
seemed affected by the central office's position on WIN-CETA relations. 
None of the nine offices in states rWhere WIN leadership viewed CETA as 
"a last resort" thought CETA services were 'highly desirable', although tin 



*We were aware that our data cn CETA politlcization and malfeasance 
may haye been affected ^y response bias. Where access to CETA resources 
was less for other reasons, bad motives might have been imputed.' Rebponses 
may also have" been colored by personal or; Interorganizatlonal rivalries 
between SESA and CETA personnel. Thus, information on CETA politlcization/ 
malfeasance collected from SESA personnel was compared in all cases possilsle 
with data from other respondents* 
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several sites staff attempted, to- use CETA selectively for some clients. 
On the other hand, all local WIN staff In the state where CETA and WIN 
units were combined thought CETA services were very desirable* So did 
four of the six units in states where WIN leadership encouraged the CETA ' 
linkage. . 

WIN staff satisfaction with CETA services . WIN staff in only nine of the 
A3 study units indicated they were very satisfied with the assistance 
obtained by their clients from CETA. Personnel in 15 other sites were 
somewhat satisfied. Finally, in nearly 40 percent of the sites (17), WIN ^ 
personnel were very unsatisfied with CETA services. Staff perceptions of * 
vthe value of CETA se'rvlces correlated strongly (r » .66, significant at the 
>01 level) with WIN access to Title VI PSE. , . 

The re&sons given for WIN discontent with CETA training .were 
presented In Table 12. 1.. The reasons expressed by some WIN staff for 
dissatisfaction with CETA PSE included^ the followii^g: • , , , 

• CETA Jobs rarely led to permanent employment in their 
locality and thus were/undesirable. - . 
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• PSE jobs were oftep undemanding and engendered poor 
work habits dr unrealistic impressions atK)ut wiiat 
would be expected on a regular job • \ * 

• Even if WIN clients were Vefe.rred to CETA,' CETA rarely' * 
/ -.^ got them into PSE jobs» CETA jobs usually went to the 

best available applicants, often coll0ge«*ed'ucated white 
males » few of ^om are WIN registrants* 

• AccessAo CETA PSB was heavily influenced by political " 
affiliation, personal connection and Intformal pre-selec- 

/y tion by the hiring agencies. Thus, AFDC recipients 

' rarely got these-. jobs. ' 

' • The low probability of getting'a WIN client into a CETA 

Job became a reason for not referring them. Raising hopes 
and then frustrating them is harmful. Reinforcing clients' 
, patterns of failure, defeat and low self-psteem should be 

avoided. 

In conclusion, we were unable to identify any association, between 
local WIN program performance and the nature ot intensity of local CETA-WIN 
relationships. While CETA-WIN relationships were generally distant, there 
were, however, a few sites where better linkages had developed and had 
led to 'greater WIN accessl to CETA resources, better information exchanges 
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and note WIN participation in CETA. If changes associated with the 1978 
reauchorization of CETA cause pr^ime sponsors to Interact more extensively 
with local WIN prograas* similar relationships might develop elseiAiere over 
time— and a greater proportion of VIN registrants might receive training 
and PSE Jobs* To the extent that such experiences actually enhance the 
employability of welfare recipients, their long-term economic and social 
prospects might be improved. "^Slnce reauthorization occurred after our data 
collection was completed , however, the. e remain hypotheses* 

« 

2. Vocational Rehabilitation • 

Local WIH^unlts generally had less contact with vocational reha- % 
bilitatlon (VR) ai^encles than with CETA and made more limited use of VR 
'services, in 'most sites "VR was an Infrequent "source of assistance to WIN 
clients. Usually that assistance was minor or short-term (l*e*, dentistry,^ 
provision of eyeglasses, testing for disability), but it occasionally 
involved more extended services such as occupational training, ^Sheltered 
workshop employment, and physical or mental rehab 11 Itatioiv. These were 
generally services that WIN had neither the funds nor the authority to 
provide. Few WIN units Indicated that J;hey referred more than two 'or 
three people per month to VR. Depending on the state, the site* or' even , ' 
the Individual case, WIN might keep clients referred to WIN in active 
(joint) caseloads, put,|:hem in suspense statu's, or de-regist^r them* 

C ontact 'and Referral • ' < - / 

■ /■ 

In all but a few sit'es, contact -between VR and WIN personnel was 
limited to bccaslorial telephone conversations and infrequent visits *by an 
individual from one program to the office of the oth^r# Referrals involved 
only telephone cojttact and the exchange of referral slips in many sites* 
Elsewhere,, a VR counselor might ^isit the WIfJ or SAU office periodically 
to review referrals. There were few iftstances In our ^sample of VR-WIN 
collocation, of VR counselors that specialized in WIN/welfare cases, or of 
Joint VR-wtN case management involving collaborative case review and planning 

Referral to VR and follow-up vas usually the responsibility of the ^ 
SAUe However^ in a few>l,tes WIN sponsor staff took lead responsibility 
for ilalson to VR because they were physically closer or had friends in VR# 
•In four sites (all in the same state) , .WIN personnel had almost n6 direct 
contact with VR. Personnel there said that, according to state policy, an 
Individual could not be a client of VR and a *WIN registrant at the samp time. 
These units sent all individuals in need of VR services back to the IMU for 
referral* to VR and de-registration from WIN. WIN personnel felt they had 
no further responsibility for such Individuals and never undertook efforts 
to monitor their progress through VR. 
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Joint Initiatives 



' Only th^ee joint program. Inltlatlycss Involving VR -aud WIK were 

Identified in our sample « and only one seemed to be clearly benefiting WIN* 
The first case was in the estate with a welfare-run WIN program, where special 
teams had been established In Wlt^l uiilts to deal with disabled AFDC recipients. 
Since few WIN registrants were disabled, the teams deemed of little value 
to WIN* The second case involvled a spec lal„ grant of state funds to experiment 
with service delivery consolidation* ' VR, WIN and the Si\^U had dperated as 
a single unit reporting to a single manager* Howffver, when funding of the 
experiment was cut, interprogram contacts returned to their pre-experiment • 
levels* In the third case (inyolviug a lar^e metro WIN unit) VR, SAU and*" 
WIN sponsor staff were housed in adjoining offic.es* There were Joint VR-WIN- 
SAU caselpads and Joint monthly case reviews Within VR there were separate 
welfare-oriented counselors* Arrangements had been developed by which WIN 
routinely paid, allowances and expenses, while VR covered actuaj. training 
costs* Staff in both programs had been trained in the other's purposes, 
procedures and documentation; WIN appraisal unit personnel were given 
special, instruction on referring 'to VR* Substantial numbers of WIN regis- 
trants reportedly benefited from VR services* . ' 
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Key Factors ^ ' 

Across our 43- sites, only seven local WIN programs had close and 
productive links to VR« What factors were at wo;rk to cause this*|eneral 
situation? ' ' . . . 

As in the case of CETA-WIN relations, the characteristics of the VR ' 
and WIN programs helped determine botli the specific rela'tionship seen in 
any one °slte and the^, general pattern of relationships observable across the 
sample a whole* Table 38 lists the factors that interview data suggested 
Influenced the intensity and productivity of VR-WIN links* If VR was chroni- 
cally short of funds or if ail Its money yas committed relatively fearly in 
the fiscal year, WIN access warf adversely affected. If VR personnel preferred 
not to work with "unmotivated" welfare recipients, that also had- a negative . 
efi^ect, as d>id lengthy delays in VR intake-assessment procedures* \ 



Table 38 
Factors Infiuenclng VR-WIN Links 



VR -Factors 



WIN Factors 



1* Availability of, funds. 

2* Attitude toward welfare clients* 

3. Speed of appraisal/acceptance*'' 

4* Eligibility policy. 



1* Policy Oft Joint VR-WIN cases* 

2* Perception of VR's competence* 

3* Attitude toward placement /develop- ^ 

mental assistance* 
4* Availability Of WIN training funds* 
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. ; tV ..... -^..-...-....-^ ... . ........ o^, s.,r. : k-V-*-. ■ .....^v^. 

.f^' • y . . ' .'^ / • • . ■ * ■ • • - ■ ■ 

'f; Finally, VR formal ellfi(lbllity crlterla--and.t!J]ie application of 

fe.: . thode criteria— vary greatly. [In several gtudy states « VR eligibility, was * 

I! * repotted to bjp very broad, IhcludiniB individuals with "emotional" problems . . ;f| 
and even victims of "cultural dejjrivation." this opensid the door to many 
WIN registrants. In sevefcal other states, a "severity" criterion was, 
' ap^ied, reflecting an intent to fpcus resources on the more setiously, * 
disabled. Interyiew'Jdat A suggested that the application" pf formal Criteria , 
• was ^'ften tempered b^^ t\te Judgment of individual VR counselors ./ ' Sometimes ■■ — 'r~z 
;« that discretion was reportedly exercl^d so th^t tho'sc most motivated and ' 

l^lkely to succeed were accepted. In such sites^rwer WIN clients were ' . 
i^- Jjikely to be admftted. ^ii^^ . 

On win's side, four factprs appeared influential. Fir'st. if it was 
. • policy that Joint VR-WIN .case* could not exist (as in the. state described 

. earlier) little cbn tact occurred' betvl^een- the two programs^ Second, there 

' were some sites where WIN harbored doubts about VR's competence and used 

It only fb*r nrlnor asslstatice (glass, dental work), if at all. Thif d local ' 
. * * WIN "programs varied in their attitude toward ttaining. or other 'forms of 

developmental assistance.' Some funQtloned ^s "straight placement" operations, ■» 
while others tried to provide what developmental assistance they could* 
Presumably, the fotraer put less emphasis on obtai^nitig VR training, for clients 
. • than the latter. Ustly, while WlN institutional training 'funds were limited .y:* 

throughout the WIN progjram^ most sites had some. They might find it less 
Important to^ seek VR-f unded training than those that had none. 
, *■*"■ ' *■ « 

We found no systematic association between the type' or intensity of. » ;° 
WIN-VR relationships dnd 'local WIN program performance." / \ ] 

, 3. Educational ifnstltutions . ^ * ^-^ 

The current national WIN program model and the advent of CETA have 
resulted in a decline, in Interaction betwfeen WIN and loqal educational . ; 

Institutions. The current program model (1) emphasizes, direct employment >'.,/' 
rather than training, (2') provides little monc>y tax institutional education . 
and training, and (3) restricts clients to at most a ysar's enrollment in ' • 

an education or training progr^im. Each of thesis elements imjjlies less ^1 
interaction with educational institutions*' In addition, under the Compre- 
hensive Employment and Training Act, prime sponsors have become the central 
conduitis of DOL training funds and programming in locil communities. In, 
„ * many instances they have replaced WIN (as .well as other programs) as a msjo^ 

source of sustenance to local educaticxial and training faqllitles* Individ-^ 
* uals flowing from programs such as WIN iiito these fikclllties often must pass 
first through the ^filter >of the prime sponsor's intake and referral process. i 
It is therefore not surprising that no relationship existed between WIN- n ^ 

educational institution linkages arid local WIN program^ performance. . 
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^overtheless »'^in many sites /per^bnal and organisational linkkgdi^. 
between WIN and local Educational inatitutiona peculated f rom jMXN*^r daysv 
Flirthetflbbrciv eoae*ufl| fundi were uand to parchAie a few training albta' \ 
'4 in most sites # In varying degrees local WIN» units alSo were taking ci** 
vantage of opportunities presented by Basic' Education Opportunitiy grants ' , 
(BBob), low cost or tuition-free public colleges and universltiest and 
CETA«»funded education ^nd training programs* ^ ' ^ « 

■ v. ' - « ' . • ' ' • . ^ 

9 Other Oreanigations or Programs 

.'•^ . V "-^ ■ - • • . , ' • - . . 

Local WIN programs generally also reported contacts of various^ 
kinds with other organizations^ or programs* Th^se incited both local 
governmental agencies and community-based organisations* On average^ s^aff 
in each local WIN program recalled recent contacts with about three such 

' entities'* Most frequently mentioned Were ..community action agencies (CAA^Sy ' 
13 sites) 9 the Urban League (10 sites). Opportunities Industrialization 
Corporation (OIC, 8 sites) / SER (6 sites), mental, health agetncies (6 sites) 

, and church- groups (5 sites)* / ^ , ■ f 

These relationships were generally quite limited^ In the case of 
CAA^s, <WIN staff in a few places reported referring ;i^n occasional registrant 
to CAA-^run programs for youth, emergency' assistance, weatherization or jadult^ 
b^^ic education/ The Urban League and OIC contacts generally involved. several 
WIN registrants who attended vocational ti^aining run by these organizations* 
WIN staff in some sites in Southwestern a^d Mountain states said that thfey 
sent some registrants to classes run by SER in l>asic education, high school 
equivarency or English-as-n-second-language; and church groups wefre mentioned y 
occasionally as a source of short-term emergency assistance^ (food, clothing 
or shelter) » Beyond that, in a few sites these organizations provided work 
Sites for WIN PSE or OJT, and in one oic two places WIN staff sejrved on their 
boards or advisory commiutees* , ' ^ . 

■ ^ . \ - p- ■ • ^ • ■ 

Maoy other organizations. or programs were mentioned by staff in 'at 
least one or two sites » They are listed in Table 39,, and the purpose of 
the contact is noted • ^ 
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Table yj ^> 
Local fiohtacf with Other drtt«olgi^tton« 



I Context or Purpose • » 

1 Member / , 4 ' < 

\ 'Memb'fer/' 

\ Job l^adSf^ presentations on . ■ , 
\ . WIN/ tax credits '. ; V 
I Nuri^e aide training ' • ...o • 

I^Site for OJT and PSE ^ 

j Prebenta^tlons as 'part of IMS or orientation 

1 ■ 
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. If 
II 



^ ritanlgetlon ^> A 
u'ulted Pund • \ 
Community Services prganlzatlonr 
Chamber Commerce/National/. * . 
Mllence of Business 
Hospitals 

Penitentiary ♦ V 

Agrlcultjaral Extension 'Service 

Legal Ald.^ ^ ' ^ 

Fjiblic Health/Family Plann:^ng/EPSDT I 

Beaut.y 'saipn ' \ \ \. - ,| 

yHomemaker advisor . ^ I 

Better Jobs" for Women - I 

Job Cotps , " I Reefer WIN youth 

* Youth* employment ^programs ^ . | V " ^ " ^ ^ 

, Special state employment programs | Occasional referrals and st'af f inter- 

. for the disadvantaged 'or 'for gener all ••actions * • " , . . °. . • 

' alvi or weliare recipients . ,1 . 

' - - '-•• '■-;•»■ ♦■■. ^ . > ' • ' 

: : : ■ : ; ; . ^ i> '■ ' — 

The .amount ,o£ Interacjtlon with communlty«-'ba8jad organizations* and 
other local programs was unrelated^ Va/^otal WlK^ui^lt performance* Statld^ 
tlcal analysis' revealed rio association be twedti performance and the number 1 
of such entitles with which WIN personnel Indicated they had contacts* 
While 13 units mentioned more aoch* relationships than fRe rest, they weire 
not. differentiated from the oyer alrl' sample .elther^^ by state, 

or by type- of locale • . > 

. Xt^Klght be hypothesized that more ' diverse and Intense llnlcs to * 
other organizations and programs' would have a% favorable Impact on WIN unit 
performance* These links, this reasoning would suggest, might allow WIN 
to obtain additional resources which would pontrlbute noticeably to' WIN 
performance* - w \ ■■ 

Our data, however , indicate no such assoclatlo'fi* Two possible 
explanations come to mind 4 . First, the costs of creating and nf^lntalnlng 
close inter organizational relatjLons may sometimes ^utWlgh the tangible 
benefits* Second , in some C£^es the tangible benefits might* be substantial, 
but the^y do ^no/t translate into higher tmit performance as measured by the 
current WIN p.brformanceTiiieasures* 1^\x& a i^ree t|^ainlng slot in an6ther 
prograip ylelc^ no dlrectjor iiomediate benefit to WIN uni|: performance in 
ter/as of ent^^red employment or welfare grant reduction* * 



0 ••>■ 



CloM llnk» to othei|[ p|t'ograia|8 ib«y «lflo benef it VlN or KtN p^rsQfitiel 



^'iii -unsMAu^ but.iMpajrt«iit 
fcciitig oi^ ability to ptovi^^ ttote assittanee clients i lielghtetied fwreonsl 
% eatleiEadtlon and morale) * Thua^ altho^ugh' such llnkagea have no mcTasufed ' 
riv. Impact on pc^forttancet they may not be without value to the program^, ita 
1; • . .clients and its staff* * \ ' ^ ^ 
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- tv ;, • the cha|>ter6 of Part IV have presented descriptions of the way 
local- WIN delivery 'Bystema are organfied- and function'. Th^y hav6 shown 
how state level' factors,' th« "major determinants" In Part III,, strongly 
affect certain aspects of Iqcal prograias, and the^^ have analyzed the In- 
teractions among local w©rk unit characteristics. Finally, they have Iden- 
Z .': tlflfid a^mumber o£ characteristics that tend to, be as^clatied with high 
' . performance j.n" loca'l Ml4j work units: This chapter summarizes and s^n- * ; 
' thcalzes tM pr/nclpal findings. Particular emphasis Is pla.ied, on those 
, • character 1st lei observe'^ most frequently In' high performing programs. ^ 



i; (!haracr6rlstlcs Associated wi th High Performance 

• • ■ ■ ■ ' , 

' ' "^irhe following chararte/lstlcs were shown by' analysis to .occur 



« • more often In high "pe^^fo^-^ing local units thaft In low performing ones. . 

>♦ < , ■ « " ' ' * ■ ' . • ' 

0 > If WIN was lnt«rated Into the employment ♦service, \, ' 

J- J ES jnanagement .'was supportive of the program. . 

V i . . This was less Important If WIN w,as self-cont^ned. •. * 

. « WIN manager^ gave priority and committed 'Sufficient- _ ^ ^ 

' ^ ' «tafr resources to the lyalntenance of accurate "isnd " ' 

timely data reporting . 



• WIN sponsor unit managers emphasized systematic 
^ distribution of . Information and ^lore frequent. 
Internal dlsc^i'sslon. * . .» 
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• « WIN managers permitted tjiarA flexibility regarding 
, work rul6s and offi ce procedtff fes . 

• wiN mBTiageM delegated more pfog ram authority to 

• • subordlnat^fe In comblnatlonfwith more monitoring. 

• Majvagers dealt more directly and openl y f^^^ conflict 
within' the, unit. *♦ 

• ' Stat f I tended tc' assist each other or routinely ex- 

change functions . » ' ' 

.•/Non-cooperative .clients were the subject of more 
extensive counsel In& e. I 



• Pgovidiott lob laarch ■killa m •■Bh^i««d . for aott 
cllontt, Vhethtr or not « fora^l IMS coaponent was 

• The SAU provided extensive auDDortlv aervlcoa bavond 
child care * 

• Job daval opaant af forte ware £ocuaed on the Individual 
cllant rather than just on generating a larga pool of 

• job ordera* , \ • * • ' ' 

• ' More, frequent and entenalve Interactions occurr^ 

between SAU and anonaor ataff l whether or not they, 
were collocated*^ Many procedurea were .carried out 
■ore collaboratively, and Joint caae conferences 
or aeetlngs occurred oore often* 



Jib 
. Regardleas of perforaance, WIN-ES 
requently Halted or hostile, and UIN 
relied little on ES job orders* 



a Less <)lverslon of WIN resources bv tlie ES waa re- 

relatlons 
often 



e 'Although links to th^ IMU were a universal problea, 
WIN staff had a cre fre'ouent contact with IMU staff * 



2. Relationships Aaong Mai or Deteralnante. Work Unit 
* Characteristics and Perforaanee 

Fi^e 12 depicts the possible Interrelationships aaong work 
unit characterlatlcs, aajor deteralnante and prograa perforaanee suggested 
by our findings* Thus, state level goals are portrayed as Influencing 
the nature of tasks and both as acting upon work unit organisation* As 
Chapter 8 explained, local staff perceptions of goals closely alrrored ^ 
those of state leaderahlp* Both were reflected. In turn. In the eaphasls 
given different tasks at the local level* Thus, for exaaple/. In the atatc 
where state -prograa leaders eaphaslzed the goal of ellalnatlng aales froa 
welfare roles, local units devoted little tlae to their feaale caseload 
or to providing day care for WIN ao there* 

Slallarly« structural eleaents of local prograas are, portrayed as 
being affected by aajor deteralnante discussed In Part III, particularly 
both organizational leadership and overall state structure* Thus, for ex- 
aaple, organisational leaders In one state alght choose to house WIN In 
ES offices, while In another they alght decide to locate WIN separately. 
At the saae tlae local unit structures partly result froa state structural 
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DETERMINANTS 



' WORK UNIT. 
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Work Unit 
Organla&tlon 



Work Unit- 
Management 



Coordination & 
Cons&unlcatlon 
Within & Among 
Work Units 
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Inter^ 
, Organizational 
Coordination 




PERFOWtANCE 



• Figure 12 

Relationahips Between Local WIN Wbrk Unit Characteristlcft a«h P^rfr.*^««.^ 



characteristics, some o£ which organisational leaders did not cdntrol. 
For example, the physical and organizational location o| local SAU's de- 
pended on political decisions^ often made decades earlier » aboujt vhat 
level of government— state or county— sjiould be primarily respc^inslble 
for administering welfare. <> . ' , j 

Vfork unit organisation is depicted 'as influencing perf jtrmance. - 
The way a number of service, delivery components (i«e.. Job deVjielopment, 
provision of Job search skills, adjudication) were organised and con- 
ducted were shown to be statistically associated with unit performance* 
While those correlations are not proof of causation, they provided a basis 

for suggesting the relationship illustrated. / 

I • * • 

Work unit management la portrayed as acting upon worlt unit organl*- 
zdtlon» coordination wlti^ln and between units » and Interorgahlzatlonal 
coord Inat loir as well as performancee It Is through unit mankgement that 
8tate«-level policies on the organization of program functions and linkages 
to other units or organisations are trancimltted to service deliverers* 
; The fact that local unit characteristics were not uniform across all^sample 
sites In each state suggests that work unit management, Itself may In some 
cases alAo play an Independent role In shaplt\g work unit or|lBanlzatlon and 
Interactions within and outside the unit* 

/ 

Because of Its Importance t work unit* management Is/ shojm as having 
an Influence on performance. In fact, much of a manager^S; effect on per- 
formance is. probably exerted Indirectly— through his or her Impact on the 
organization' of service delivery functions and on Interactions within and 
^alQong unltse . ^ ! ; 

Coordination and communication within and between units are por- , 
trayed as influenced by work unit management (as described above). Co- 
ordination and communication are depicted as acting on performance directly 
since a number ' of such variables that are closely associ|kted with the 
actual delivery, of services and t,he generation of unit pierformance data 
were associated statistically with performance. These included intraunit 
variables (i*e.', infocmatian transfers, task exchanges 4tid conflict reso^ 
lutlon) as well as int^runit variables (i.e,, SAU*-WIN sponsor interactions 
. and WIN-IMU 'contacts) i • * / 

■ ; , • ' . • . . ■ : ^ • ■ ' 

Lastly; Interoganlzatiohal coordination is shown as affected by 
work unit management.- In the case of CETA-WIN ^links a^ least, work unit 
management probably acted in som^' cases as an intermediary variable trans- 
mitting state level attitudes ab( it the' desirability p'f the relationship. 
' Interorganlzatlonal coordination is not depicted as al^fecting performance 
since our analysis of WIN links to CETA, VR or other Organizations did 
.not demonstrate any associat; ions with performance-. - ^ -, 
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The permeating InC^uence of state level variables is one this 
chapter's most slgaiflcant points* .Vftiether the Issue" was unit priorities, 
managtnent behavior or attitudes toward CETi^, local characteristics ..were . 
extensively shaped by those at 8tat(e level. Ftom the fedj|ral viewpoint, 
this findings Is Important. It suggests that federal personnel need not 
reach down to the local level In over a thousand localities In order to 
have an Impact on program operatlona and perfonnance. -• Rather, by Influ- 
encing attitudes and practices of only SO sets of program and organisation 
leaders at the state level, federal officials can be confident of also 
affecting behavior in a high proportion of local service delivery systems. 
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PART V 

IMPROVING WIN PROGRAHS, ?| 



"^eoifio changes in tow perfoming programs are jreaomtended based on the 
pa aharaoteristiae found in high performers. Managerial recommendations 

inOi^^v^t • ' 

V 

• Improve goal auareness and applioatiGni- 

• ' Enhance evaluative, analytic and monitoring 

capacities at the state central office and ^ ; 

area levels* . ' 

• Expand training activities^ especially around 
management functions^ reporting systems^ 
financial systems:^ and welfare/ employment 
program or service delivery innovations. 

I * * * • 
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« SUMMARY . 

The information in preceding Parts is now used to address the undetly- 
ing issue of this studyr-how to improve, ^f/IN program per formanoe* Performanoe 
improvement strategies require, first, tl^e capacity' to accurately differen-" 
tiate high ffom low performing programs, ' Recomendations aimed at developing 
tliat capacity .include: , 

# Improving the retention rate and welfare grant reduO" 
tion perfomanoe- measures. 

♦ * • - ^ 

0 Adjusting performance for environmental difficulty 
so that relative effectiveness measures take into 
" account labor market and client demographic oondi- <, . 

tions beyond the control of program personnel,, ) 

0 Creating SAU effectiveness indicators, v 

» •„ . • • 

• • Improving .automated reporting systems at th& state > , 

level. 

Once, law performing state programs are identified, both federal and state / 
personnel must have the ability to diagnose the underlying problems, Develop- 
•ment -of diagnostic monitoring systems is proposed that would focus regional • 
federal representative's monitoring on the performance of^tate and local "^IN 
programs and on information about administrative, managerial, service delivery 
and coordinative functions related to that performance. Transmission of thc^e 
methods from regional to state program personnel and joint development of . 
performanoe improvement efforts are recommended. 



# Inteneify SAU^aponeor ooovdination and oollabovaHon, , ^. • 

R^oamendatione for ohangea in aexvioe delivwy methada or emhoBas include : ■ 

♦ # ihjpAiaatse oomaeling and working more intensively - 
. ' ^th reluctant xslienta rather than ignoring or . 
quickly awiotioning. them, ' 

* • - ' . ■ ' • * ■ " » 

* \ - • Place more emphdbia on imparting job^aeeking ekilla ' 
\ and on job^aearch activitiee by clients themaelvea, 

# Emphaaize olient'oriented Job development, , 

• Experiment with expanded institutional training 

for some clients, . . - .* . . 

# Develop richer mixes of supportive services,. 

# Improve the critical linkage to.IlfU's, 

^Although some incentives for change already ejxiat, incentive atruoturea 
need to be strengthened. Our proposals include a more straightforward and objec 
tive performance incentive funding system^ dissemination of information on 
the comparative performance of state programs i^hroughout. the WINy^system^ and, ' 
in extreme cases, the selection of ^alternative WIN sponsors, 

l/hil^e memy of these suggestions might be implemented separately, they 
. are also the building 'blocks, of an integrated, sequential approach to 
improving the WIN program,- The basic elements of a struatuved performance 
' improvement program are: . 

' • ■ Joint development of {improvement strategies by 

national, regional and state officials, • 

s 

# Developifient, and .application of a performance 
incentive funding, system' for use at both the 

, ' ^ federal and state levels, 

# Development and use of monitoring guides to 
target improvement assistance, incentives- ' 
and sanctions, ' ■ 

# Periodic data collection and anally sis of a 

, sample of local WIN, units representative 'Of 

alt WIN units to permit continuous monitoring 
of changes- in environment, organization and 
. performance throughout the WIN system and to ' 
guide actions taken in performance improve" 
ment projects. 
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Stvuotured organisational ohange and pe'pfomanoe 
improvement projeote in aeleqted etate and local 
progrme, 

Ccmpaviaon of data from theae "experimental" . 

aitea with data from mi^t^ in the repreaentative 

ecmple, leading to firmer oonoluaiona on what 
^organizational ofuxraoteriatida influpnoe WIN. 
^performance and what change atrategiea are 

moat effective* • ^ 

Dieaeminatioh and general application of the ■ 
knowledge derived about how .to make' wet fare- 
employment programa -more productive, / 
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' CHAPTER,jil 
IMPROVING WIf PROGRAMS 



t 0 



/ 



' • * Introduction ^ ^ 

* "■ . • • » 

The preceding chapters have described %>hat has been learned about 
the measurement of WIN per£ormanc,<j!, the environmental factors that inf^lu- 
ence WIN productivity, and the ^m^nagerlal , organisational and service 
delivery characteristics associated' with high performing programs. In ' 
this chapter we use that Information to address the underlying issue of 
this study — how to Improve Wl^N program performance. A general strategy 
la presented that alms at applying what has been learned to Improve the 
'WIN system 'and to develop a prjocess' for continuous learning and Improve- 
ment in the future. Where thei leveJL of confidence and precision of our 
findings penfilts, recommendations are made for immediate syateax-\*lde ac- 
tion.. . ' .7 

♦ - " ' . 

Tlte chapter begins by noting that performance' Improvement strate- 
gies require, first, the capacity to accurately differentiate high from 
low 'performing programs • Ways of creating that capacity are proposed* 

* 

Once low performing state programs are identified, a federal ^ 
ability to diagnose their problems is necessary. Similarly, states must 
have the means to assess the causes of low performahce in local programs. 
Recommendiaitlons are made aimed at developing these abilities at both the 

federal and state levels. ^ 

/ 

Next, knowledge about what specific changes to make are needed. 
Thus specific actions 'are recommended based on the pattern of ' character- 
istlcs' found in high performing programs. Incentives for change are al- 
ready present in state and local programs, since many state and ipcal 
staff In low performing operations want' to improve their programs. What 
.is required is "some guidance on what to change and how as well^ as some 
reward for Increasing productivity. Thus incentive structures' should be 
strengthened. Our proposals Include a more straightforward and objective 
performance Incentive funding system, dissemination of information on 
the (comparative performance of state programs throughout the WIN system, 
and, In extreme cases, the .selection of alternative , WIN sponsors. 
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Finally, we preicnt a toheaiveand •ystematic attategy incorporate 
Ing many of these tecommendatlpns into. a performance improvement program. 
Thiji program would involV^ luio«rUdg« devalopmant through •xperinentatidn 
in* selected state and local operations* Experimentation is Tequlred in 
order to test the appropriateness and feasibility of different organisa- 
tional' change strategies as weH as their impact on WIN performance* 

As we have already noted, many of our recommendations for improv- 
ing program performance are based on tentative or qualitative evidence. 
'This is necessarily the case giveA- the 'exploratory nature of this study., 
f Also, so'tbe key variables may change over time with unknown consequences 
■ for performance. Therefore, a system for monitoring the effect of changes 
in environment,, organization and performance in a representative sample 
of local WIN programs 'is presented as part of the performance improvement 
program. Comparing what occurred in experimental operations with what 
happened within this sample would permit more definitive conclusions about 
the effects of changes in organisational characteristi^a.^nd service de- 
livery methods on ° program performance. The knowl>id«<clerived about how * 
to make welfare-em^lo;ipent programs more productive could then be dis- ^ 
seminated and applied generally in the expectation that it might raipe 
performance levels throughout the WIN system'. 

■' • • * 

2. Identifving High and Low Performance 

As noted above, a precondition for improving perfprmance is the 
capacity to identify high anjl low performance. Assuming no fundamental 
changes In program goals or structure, three actions mtxpt be taken to at- 
tain this capacity. ; First, WIN performance measures should be further re- 
fined and institutionalized. Second, SAU effectiveness indicators should 
be developed. Third, automated reporting systems- mtist be improved « ■ 

VtlN Performance Measures 

Refinement and institutionalization of WIN perform^ce Aeasures 
involves seven sequential steps* Because these steps are similar to pro«- 
cedures used in selecting sample states and local unfts for this study, 
the National Office could initiate action on this recommendation almost 
Immediately (see Chapter 2 and ^Appendices A and B). The seven xequired 
steps are • 

• Agree on the conceptual appropriateness of the 
measures a At the outset of this study, federal 
program leaders agreed that jpb entries^ job 
entry wage rate, retention rate and welfare grant 
reductions reflected the program^s quantitative 
and qualitative obJertivesJ A similar, consensus 
would be needed again* , ^. 



Aftf on ralatlv priority among theae .aeaaurea « 
Once again, program laaders %rauld have to review 
the relimtlye weigUtit aeelgned to eat^h eepaj^ate ' 

performance meaeure'io that appropriate overall 
state or local unit effectiveness Indices could > 
be computed. Policy shifts could be reflected 
,ln changes In those wplgtits* ' 

Improve retention rate measure * A more realistic ^ 
Indicator of job retention would measure the' 
proportion of all (or a ^random sample of) fti^ll-tlme 
'job entrants* that were still employed 30, 9Q or 180 
days later. Current studies being conducted within < 
OWIN indicate tha^* longer follow-up pe'rlod would^ 
better estimate tn^acfiual duration on employment 
of those WIN Registrants finding jobs. This woul'd • 
provide more accurate Information on the quality of 
all full-time tiob entries, the effect of different 
service mixes on long-term" employablllty an^lie' ^ 
apprcipt lateness of job-registrant matches'^e^ ^ ■ 
Chapter 2 and AppeAdlx B) . * ' 

Improve average monthly welfare grant reduction 
data . The accuracy of reported average monthly 
welfare grant reductions ^.wa)S reduced by varlatldns ^ 
In how state and local INU offices chose to define' 
welfare: savings and by IHU linkage problems. Types 
of grant reductions to be. In^cluded and excluded In 
calculations for WIN reporting purposes should be ' 
standardized across and within states. Stete end 
local st^f f should receive guidance .on the Importance 
of .this reporting to their program's performance and 
funding as well as Information on various ways o£ 
conveying that significance to IMy personnel. , 
Improving the IMU linkage In general Is discussed In . 
Section 4. ' 

Standardized performance measures . Three of the four 
current measures must be standardl'^eed to permit state- 
to-state comparisons In order to account for differences 
in program staffing levels, welfare grant size or 
prevailing wage rates, (see Chapter 2). 
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• Adjust performance fog envlronaentMl dlf figultv . / 

Develop ''the necessary labor nafket, demographic 
' and program datji bate* conduct the required . 

iBultlvar late analysis to take Into consideration 
the effect of soclo-economlp environment on ^ * 
'program' performance and to estimate t^e levels 
of effectiveness that coul^ realistically be 
expected of stated programsV These ef fectljveness ' 
levels would reflect more equitably the relative 
performance df state programis, ^Ince they would 
take Into account significant differences in 
labor-market and client d^ographic conditions— 
conditions beyond the 'control of program personnel. *^ 
States that scored higher tlian' expec't^fl given their 
environment would be high performers. Those that 
^scored lower than expected wquld be low performers* 

• 

»• Inititutlonaliize this process . Establish procedures 
ffor the periodic generatidn of the necessary perform- 
*^'ance and environmental da|:'a and develop a capability ^ 
within OWIN to conduct the required analytic proce- ' 
. dures wlthbut outside assistance. " . 

J ».' ••. 

the^ results of this process could be applied not only to the identi 
f Icatlon of low performers for evaluation and performance improvement pur- 
poses but also could be an Integral pa^t of resource allocation, planning 
and actlv|.ty level assignment procedures. The development of this , planning 
evaluation-allocation system is dlscucaed In Section 6. 

» ■ ■ ' 

SAU Effectiveness Indicators . . ♦ 

The lack of SAUi performance liieasures and of Information about he 
relationship between SAU activities and overall WIN performance has been 
mentli^ned repeatedly. Research currently being conducted for OWIN on local 
SAU ^rg<anlzation '"and functions may provide a better basis for addressing 
both shortcomings. Both SAU performance measure's and their relatloi^ship 
to overall WIN performance require, however, consideration of the appro- ^ 
prlate ro^ie of the SAU in the WIN program. While our findings (especially 
on the- coordlnatlve role of SAU's and the nature of SAU-WIN links in high 
performing state and local programs)^ provide some guidance', <. more thought 
and analysis is clearly necessary. 

I 

An essential preliminary step would be for policy makers and WIN' 
officials to further discuss "and clarify the 'future role of the SAU.' There 
are several posjs lb le roles the SAU might take, but two are most obvious. 
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pirst; the SAIJ could eXl8t e»»ej»tlally to, provide locUl Mrvlcee f or WX» • 1 
clients* Thls'U Its' curret>t mission* ^ternatlvely, WXN tesks and * 
responsl1>illties c^uld be restructured so SAU pUyed a more Integrated' \ ; 

role In the employment and* training. mission ot WIK* \, * 



Whatever role la finally defined, fourJst^s would be required 
before 'effectiveness me&sures could be Itt placet 

e Using the currently defined balanced mission of . 
' ; WIN, 4evelop logical models and hypotheses of what 
. types of^ SAU functions Should ' a t>rlorl Impact oflj 
. the^'overall effectiveness of WIN.* . * Tl^ese models f- ' 
* ' ' woVld be developed based on what past research / 
" . . and program officials theorise should? effect WIN 
performance** > • ^ 



In a carefully designed study, collect information 
and.vpreclse data on SAU variables hypothesised to 
Influence WIN perfojrmance* * > . ' 

Analyze the SAU variables Identified and their Im- 
"^pact oii" placement a^nd employabllity enhancement* 
Identify- the Impact of these. factors on the main 
WIN performance- measures -In the balanced' program 
mission* ■ 



*Such hypotheses could Include the following; ^ 
^ e K^cher mixes 'of supportive services should^be , 
positively related to Job retention and overall 
, program performance* 

* » 

. ■ e "personal counseling should Increase the blllty of 
a welfare recipient to obtain and retain a Job* ' 

e The quality and avallabllity/of child care will be 
ppsitlv€fl.y associated with^ob entry "and retention, 
especially among^Uleigal^,/-WiN registrants* 

, • If so, SAU'^^hat emphasize developing child care 
resources should be more productive* v- 

. • Smooth ;tjrans it ion of supportive service cases from the 
SAU to Title XX should, be positively ^elated 'to Job 

retention* , \ ' . . 



• Incorporate within a comprehensive reporting system v . . « j . 

SAU Indicators that reliably measure those SAU ac- > ' 
tlvltles that haVe been shown through analysis ^ . ^ . {{ 

« to contribute to overall WIN performance, and use * " 
these data In the proposed planning, allocation 
and assessment system* 

Improve Automated Reporting Svateps , ». • * * 

Earlier chapters documented problems with automated reporting * 
systemd. While several hlgli performing programs had very accurate sys- 
tems which they -themselves depended on for management purposes, other 
states systems were error-ridden and a constant"* problem for staff and • 
administrators. If Increasing reliance Is to be placed on these systems 
to Identify, reward and Stimulate performance, such' situations should be 
alleviated wherever possible. 

Part of this responsibility Is feSeral. Clearly, computer programs 
should be debugged before distribution to the states, and documentation 
should define data items specifically. Regional office capabilities to 
provide technical assistance on reporting sjstems and, computer Izatlbn 
should be enhanced where possible by recruitment and training. This might 
Involve the Identification of a knowledgeable and competent system analyst 
In a state WIN program within the region and the assignment of this In- 
dividual on an IPA basis to the regional office. In this way, the analyst 
^could train regional staff on starts, systems as well as assist other stat^ 
programs In the region. In addition, regional .WIN units should Impress 
on the states the direct linkage between their reporting, ^helr performance 
and their funding. Informing t^ie states more clearly about why reporting 
Is Important to them should lead more state programs to give greater jit- 
tentlon to their information, systems. ' 

■ ^ ■ . ,. ' ■> 

The states themsdlves can learn from the example of the high per- 
formers within our sample.. All of them had comparatively few reporting 
problems or had significantly improved the accura^yr and timeliness of their 
systems, their experience suggests that states seeking to Improve their 
reporting (and their own management information la the process) should' 
consider the following: 



Hiring their own system^ analyst /prog rammers to 
provide full-time repor \g system services for 
WIN (Including participt. :ion in all central 
office staff meetings and provision of training, 
instructional material and trouble-shooting 
assistance to local service delivery personnel) » 

Funding specific SESA reporting systems staff to 
perform the same functions. 

Developing computer interfaces or regular data 
tape exchanges between WIN sponsor and SAU/iMU 
reporting systems to Identify and resolve data 
inconsistencies or other problems. 
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• Training «nd retraining of ataff on a periodic 
baaia on form completion t data inputs error 
' correction procedures » and the relet ionahip 

between reporting data and program funding* 

e Developing procedures and ^^uidelinea for state 
monitoring and assessment of local WIN operations 
using HIS data an4 auggeating waya that local 
managers and supervisors could use MIS data to 
monitor their o%m operations • 

\ 

3# Developing Diagnostic Capabilities ^ 

Once low performing state operations are Identified, regional 
office staff should be able to determine the causes of their lev per- 
formance* Diagnosis necessarily precedes any development of performance 
improvement strategies by state and federal officials. 

Currently^ federal representatives have few tools tp use in diag- 
no^ting the. reasons for low performance* Monitoring visits to state WIN 
pcograms usually follow a fairly unstructured pattern and involve rela- 
tively little contact with WIN staff members In the state ^central office, 
other state officials or local service delivery personnel* On the rare 
occasion when local units* are visited, generally only the WIN sponsor and 
SAU supervisors are contacted* Visits are usually "evc^nt-baded^" for 
example, to review or negotiate state WIN plans, or to resolve specific 
f/iscal or procedural problems* Such /Visits fall to provide federal rep- 
resentatives with a comprehensive picture of the state operation atid the 
knowledge with which to diagnose or at least hypothesize the causes of ^ 
low performance* t - 

Focusing the resources of federal representatives on specific data 
collection activities during monitoring' visits would likely improve their . 
knowledge of state operations and those factors contributing^ to local per- 
formance* This could be accomplished through the development , of a struc- 
tured monitoring Instrument which would provide comparable information 
within and across regions* Such an Instrument might resemble the research 
interview guides developed for uhls study, refined and adapted for regional 
use* It would provide federal representatives with information on rela-* 
tlonshlps between state and local staff, relationships with host agencies, 
the structural characteristics of both sponsor and SAU systems, the way 
managerial functions were being conducted at the state and local levels, 
the different procedures being used in the provision of WIN and SAU serv- 
ices , and perceived barriers to performance improvement* 
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, The Instrumerit would .designate what' questloHa to ask of certain 
types of respondents and which data t.o obllec't from information systems. 
It would permit cross-verlf Ication of information obtained from different,, 
sources and provide a structure that could be use'd to identify factors 
that might, be contribujtln^ to low performance. This iriformation coul,d 
Xhen be used in developing reports on state operations "and in discussions 
with state officials about possible ways of improving their operations. 

. The use of the proposed monitoring instrument should not be re- 
stricted to low performing programs only. Much can be learned from high 
performers that might be transferable to low performers in the same region. 
However, scarce regional resources might be focused first on tlie^programs 
with the Ibw^est performance records in the region. Over time, other state 
WIN programs could receive similar attention. The eventual purpose should 
be to develop annually a description of each state program In the region, 
problems being encoun tare a, improvements being implemented and the prog- 
nosis for the future. , - . 

The development and use of this monitoring instrument could have 
a number of benefits for the federal part of the WIN system. Some of these 
are as follows: 

• Improved 'knowledge of state WIN programs by federal 
representatives leading to increased appreciation 
for operational realities and ^-improved regional 
credibility with state and local personnel. 

• Development of an Information base in each regional 
office on all state operations in the reg^ion, per- 
mitting federal representatives to learn from each 
other's programs and facilitating more extensive 
communications among istates on ways to improve 
their operations* / • 

• Identification of program areas (e*g,, reporting 
systems, management skills, service delivery tech- 
niques, etCtf) that most need improvement in the 
region so that scarce resources can be targeted 
on them* 

Identification of state programs with staff ex- 
pertise that could be used to imprqve operations 
la other states in the region • i 
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Itilproved basis for assessing and l^ibprovingl the 
perforaance and analytic skills p^t federaij rep-* 
senfeatlves (through quality cjsntrol revljavs of 
monitor^iag instruments and rei 
WIN coordlhators) * 




rts by regl|0nal 



• Improved knowledge of stati^ and local program 
operajiions by national administrators andj staff 
(acquired through the review of monitoring reports 
submitted by regional /of flees) and thus more en* 
lightened consideration of the impact on 'state and 
I^cal programs of possible policy change^* 

lJnd^t.^the proposed monl touring system, the nktional office would 
maintain ^e nationwide data necessary for tracking, changes in state per- 
formancei' National offl^i^lals would also be respons'ible for 4eveloplng 
and validating the «monl,l:o ring instruments or guide^* However, regional 
officer would play th^' major role in diagnosing prbblems in states as 
well ^s developing 'strategies for improvement* Regional federal repre- 
sen^tlves would be expected to identify when a state was "in trouble" 
and diagnose what /the problems were* They would acquire this capability 
through^ training, assistance, manuals and informatjion from the national 
office* ' • 



Federal representatives could transfer the diagnostic methods 
they learned to state WIN sponsor and SAU coordinators*' The coordinators 
should thus become more able<^to diagnose problems within th^lr own states* 
A separate per£ormai\ce data system*which would triick a nationally rep re*- . 
sentatlve sample of local WIN programs could provide state managers with 
st^'aadards by which they could monitor the performance of their own local 
units (see Section 6)* This would help them identify' local programs having 
performance problems* With the information and assistance provided by the 
regional office representative, they would then be able to diagnose the 
causes of those local problems^ Thus, f ederal<-managers would be respon- 
sible for identifying and diagnosing low performing states, while state 
managers would be responsible for identifying and diagnosing low perform- 
ing .local unit§* ' ' 

♦ * f 

V 

Once problems were identified at the state level, federal and state 
managers would decide Jointly on what changes should be made* Of course, 
state programs could, choose either to participate In such a venture or 
to refuse federal assistance* Thus, some system of incentives must be 
operating to encourage state and local managers to implement changes and 
mak^ an effort to improve their program performance* Such incentives are 
addressed in Section 5* 
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4. ' Changing Program Character let tea 

A major finding of this study Is that high and low performltig ' 
programs systematically differ in certain organisational, managerial and 
service delivery characteristics. The following recommendations are based 
on this finding and represent actions that could be taken at various pro- 
gram levels to change the characteristics of low performing operations 
to more closely resemble those of high performers* The underlying hy- 
pothesis is that these charatteristics play a role In determining per- 
formance levels and that changing these characteristics should result 
In- higher performance. Verifying whether such changes actually cause 
higher performance would require experimentation, which is discussed in" 
Section 6. 

Another major finding was the dominant Influence of state WIN 
policy on certain aspects of 'local operations* For example, state defi- 
nitions of WIN goals quickly became thoSjC of most local units* MIS data 
were u'sed more extensively to manage local units in states that placed' ' ^ 
priority on maintaining accurate and timely reporting systems. If central 
offices periodically monitored local operations and provided feedback 
based on these evaluations, local managers were more likely to replicate 
such actions in their own units. Significantly, the way many of these 
functions (e.g., goal definition, planning, monitoring, evaluation, data 
reporting, and training) were executed was closely associated with program 
performance. , 

Our finding on the extent of state Influence over local units 
provides i;uldance to federal efforts aimed at improving local service de- 
livery and performance. It suggests that federal initiatives can have 
their broadest effect if focused on the state SAU and WIN sponsor co- 
ordinators and their central staff.' The aim should be to alter their 
priorities, capacities ' and behavior in the expectation that this will 
have a ^'ripple effect" at > the service delivery level. 

Other findings concerned local program characteristics that were 
not necessarily influenced by state program policy. Local managers and 
staff were generally given discretion in many program areas, including 
service delivery emphases, management methods and Interagency, linkages . 
These characteristics were related to local performance but varied among 
units within any single state. Such local discretion will probably con- 
tinue in the futures Therefore, findings and jrecommendations on these 
characteristics should be disseminated to loca l personnel for possible 
applications. Where recommendations are applied, local managers should 



224 



document ahd' distribute information about their experiences, since locbl 
units elsewhere 9ould benefit from knowledge abojat these attempts to im- 
prove performance and their outcomes* ■ ^ 

'< ' ' ' ' *• 

In the absence of moreVdefinit^ve knowledge* our qualitative find- 
ings on the chairacteristics Of * high performing programs provide a basis 
for actions which can be taken by state and docal personnel to Improve 
theit program's performanqe* These include modifying the way management 
functions are performed and altering service delivery emphases and pro- 
cedures* Obviously, the degree to which such changes are made and the 
speed with which they occur nay be contingent on the attitudes and ca- 
pabilities of program staff and the mores of the host agency as a whole, 
but the direction can at least be indicated* 

Managerial Functions 

Improvements In the management functions of state WIN programs can 
be focused In six areas: . 

') ■ . - , ' . ■■ ■ • • 

• Improve goal awareness and application • In high 
performing programs the balanced character 'of pro-* 
gram goals was understood at the state level » and 
the relative priorities among these goals were. 

• transmitted to local managers and supervisors* \ 
Personnel at each level understood what program 
goals were and how federal funding mcSchanlsms re- 
warded their attainment • <At present, the critical 
message Is that wage rates, duration of jobs and 
welfare saving are at least as Important as num- 
bers of placements*) Techniques to use can include 
training sessions, statewide conferences, written 
materials and monitoring /feedback systems* 

• Enhance monitoring > evaluation and analytic capac- 
ities * Developing monitoring Instruments and improv- 
ing reporting systems have already been mentioned* 
Complementary actions by state coordinators could 
includes (1) adding an Individual with analytic 

and evaluative skills to central staff if there 
are none now; (2) maintaining relative performance 
rankings of local units on a monthly basis and 
communicating these rankings to all local units; 
(3) monitoring operational data oh a frequent ba- 
sis; (4) maintaining and reviewing fiscal tracking 
reports by area or unit; (5) monitoring low pef- ^ 
forming units more intensely, analyzing information 
to identify the causes of problems in these offices. 
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and developing Jointly %rlth the local unit ways 
of Improving their operation; (6) developing local 
unit *'6el£-»appral8aV* syatemst (7) establishing 
a cadre of "field technicians*' ^^lAo periodically r 
vlplt each local unit; (8) field monitoring of 
each unit by central office personnel on at least 
an annual basis; and (9) Joint SAU-WIN sponsor 
site reviews conducted by personnel from both cen~ 
tral offices. » 

Conduct annual planning and budgeting. jointly with 
greater Involvement of field staff . Develop lnte-> 
grated state WIN plans and budgets that Incorporate 
complementary sponsor/SAU activity estimates » goals* 
allocation patterns and service delivery or adminis- 
trative innovation}. This process, should involve 
not only detailec consultation between WIN .sponsor * 
and SAU coordinators and their central staff but 
also early and genuine* participation by manag/ers 
and staff at the area and local levels (see Chap- 
ters. 6 and 9 ) . 

Expand training activities . The amount and variety \ 
of training, was far greater in high performing 
states.' Exactly which types of training are most 
significant is less obvious » but our knowledge 
of high performance characteristics and our survey 
of reported state training needs suggest an initial 
training agenda. Areas where instruction might be 
emphasized include: program goals and activ- 

ities rewarded by performance incentive funding 
mechanisms; (2) the conduct of management functions; 
(3) 'reporting systems; (4) ' financial management; 

(5) the changing character of the overall welfare- 
employment system, including WIN sponsor-SAU link- 
ages and' relations to IMU, Title XX and CETA; and 

(6) service delivery modifications such as those 
mentioned in the next section. Training should be , 
conducted jointly for sponsor and SAU personnel , 

and personnel from potentially important outside 
programs (IMU, Title XX, CETA, vocational re- 
hab ill tal: ion, education and training agencies) 
should be involved. Training should take the form 
not only^ of formal instruction but also less formal 
meetings, all-staff conferences and problem-solving 
sessions. 



226 



• Intensify SAU-aoonaor coordination and collabora- 
' *. tlon . Vhlle .physical collocatlbn^'Of the state 

WIN coordinators nay often ba Infeaslble or even 

undesirable, closer interactions between them (and 
.'their staf^') seems a distinctive characteristic \ 
' > ' q£ high performing programs^ 'Both partners should* 
theifefore, seek to develop (U more integrated,/ 
^ collaboiratlve annual plan and budget processes; 
(2) Joint training, staff meetings, field visits, 
handbooks and field directives; (3) Informal ways 
• * to resolve differences;, (A) the habit of dally or - 

weekly informal consultation; an4 (5) qollabpratlVe 
stra^tegies for deallng^ with constraints imposed, by 
•host agency attitudes, structures or procedures* 

t Alter declslon-waklnR and conununtcatlon. patterns * 
OVeif a period of several years, patterns of decision- 
making and communication should be altered so that „ 
they approach those observed In high performing pro- 
grams. Ab,rupt change may^be hard or even counter- 
productive, but gradually' mqre open lateral and 
upward communication flows should be develo^jed and • ^ 

more partljiipatlve^ delegatlve, decision-making ^ 
encouraged (see Chapter 6)> Like other management^ 
characteristics, this behavior by state and atea 
managers will be emulated by many local unit man'^ 
agers* That should lead to more complete 'informa- 
tion exchange, more staff participation, gredter 
staff discretion and delegation of authority, and 
better accountability systems within local units. 
Since these are the characteristics associated 
with high performance in local units, that process 
should be reinforced by Instruction, example and 
support . ' 

Delivering Services " ' 

' Chapter 10 described the service delivery characteristics that 
ateemed associated with high local program performance. These findings, 
although tentative, can provide guidance to administrators and managers 
who want to explore ways &£ Improving local unit performance. Sugges- 
tions Include: 

• Emphasize counseling and working more Intensively 
with reluctant clients as, part of the adjudication 
process rather than ignoring or quickly sanctioning 
them. 
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gxperlae nt with more Inf naive and axtandgd gollrfi».iip 
lirodedures such as 60«day, 90-day and ISOrday follow- 
ups and spot checks on a smai:^ percentage of Job 
entrants one 'or two years after placement • 

Place mo re emphasis on Imparting iob^siaeklne skills 
and o'n l ob .search activities bv clients themselves . 
Priority on either formal job search assistance ' 
services fiuch aspgroup workshops or "job. clubd" or , 
individualized approaches jfjtivolving a client and a 
. counselor was associated with high performance » 

Emphasize client-oriented 1ob development by (1) 
Identifying Individual jobs for Individual clients 
rather than only, developing a pool of job otders, 
or by, (2) emphasizing client Job search with staff 
guidance and assistance* 

Experiment with expanded institutional traininte for , 
clients* Many service deliverers believed the de- 
velopment of individualized training programs for ' 
-selected clients can be effective tf careful assess- 
ment of the client's capabilities, labor market 
conditions and available training programs indicate 
significant gains in economic and social well-being 
would likely result. Such efforts could involve 
the "packaging" of various resources (WIN and TRE 
funds; BEOG, Title XX and CETA resources; and tuition- 
free offerings) to maximize benefits and minimize 
program costs. Waiver of the one-year limit on, 
institutional training in selected cases might also 
be required since training for higher skill, better 
paying jobs often takes longer. 

Develop richer- mixes of supportive services . Pro- 
grans that provided supportive services beyond 
child care tended t'o be higher performers. Such 
expansion of services could include (1) home visits 
to all registrants; (2) counseling on personal de- 
velopment, family relations, household management 
and family planning; and (3) provision of emergency 
money end temporary transportation. 

Increase Sponsor-SAU interactions . Some of the 
earlier recommendations on SAU-WIN sponsor director 
collaboration have obvious implications for service 
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delivery level Int'eractions. Beyond thet, (L) 
iQCi^l spontor-SAU supervieore end staff should 
tteet\perlodlceliy. td diteueji pco$ra« Iteuee; (2) 

monthly joint case reviews should' be instituted; 
(3) client or ^'^n tat io9 and counseling should he 
conducted col \ boratlyely although not necessarily, 
jointly ;\and \h) procedures appropriate to the 
site should- be developed to deal with sponsor-SAU^ 
work and information flow requirements* - 

• * \ ^ • 

e Apply variauBV strategies for improving the critical 
linkage to IMUXs . This -relationship is both im- 
portant to effective WIN operation and a universal, 
problem* Techniques that may prove helpful in 
improving this linkage include: (U periodic or 
event~related meetings of IHU, SAU and spoi^sor 
supervisors; (2) periodic presentations to IHU 
• staff on WIN objectives, procedures land services, 
and on the importance Nof certain tMU actions to 
the program; (3) using \wiN funds tb provide formal 
training to IMU personnel on WIN; (A) Joint ^IMU- 
SAU-sponsor traininjg; (5) collocating IMU staff 
with WIN staff in large metropolitan areas and 
making their caseloads exclusively WIN reglstants; 
(6) designating a liaison person in the state wel- 
fare agency to deal with WIN-IMU problems; and 
^(7) developing automated welfare ^reporting systems 
that reduce the amount of paperwork associated with 
WIN-IMU transactions or creating the capability 
to. dccess the welfare data base to verify and 
. Identify welfare grant reductions and "obtained 
employments." ' ' , 

Where WIN Is Integrated In the ES 

A WIN program that is Integrated within an ES hierarchy may face 
different challenges when it seeks to improve its performance than would 
a self-contained ^program* Fart of the reason why such a program is low-* 
performing might be host 'agency characteristics rather than those of the 
i>rogram per see This would be particularly true where host agency atti- 
tudes toward WIN were negatives priority for WllUwas low» and both goal - 
displacement and resource diversion were extensive* The two high-perfom 
ing programs described in Chapter 6» Section 6\ provide the basis for 
suggesting a three- phase strategy for dealing with such situations « The 
first phase woold involve; 



229 




Efforts to shift to a more aelf^contalned structure » 
Timely and sVLlllful maneuvering may permit the WIN 
sponsor coordinator to gradually obtain more direct 
control over and communicatlbn to Ideal units* The 
evidence derived fi:om monitoring systems described 
earlier and the effects of low performance on federal 
funding could be used* to build a case for siuch a ^ \ 
change* Federal regional Q.fficlals» where 'sympathetic* 
could be utilized to facilitate this protess in soifie, 
cases » ' 



Opportunistic > selective acquisition x)f staff * In ' ' 
SESA's where changes In state political leadership or 
agency management Qause slgn;Lf leant: staff displace^ 
ment^t these situations can sqmetlmes be exploited 
to -the benefit of WIN* So can contractions In other 
programs* Several high performing states have built 
effective administrative and service delivery cadre 
by selectively recruiting among the ^'outcasts'* caused 
by such changes* ^ * . .. ' o^. 



Tliese steps (along with managerial and- service delivery modifications such 
as described previously) may effectively "turn* around" a- low performing 
program* If efforts to mov^ toward self-Qont^lnmeat ate infeasible, the ^ 
strategy of "changing a SESA's .priorities" milght be trle(i next* Thi^ tnight 
involve : ^ " . . . / 

m Vigorous federal regional intervention on behalf ^f . 
the program at the SESA executive director level * • 

• Resulting modification in host agency leaders^ own 
attitudes toward and priorities for thB progriam *^^ 

• Transmission 'bf those changed attitudes and^prlor' * 
Itles to subordinates throughout the ES hierarchy, 
resulting in phanges in their attitudes "or behavior* 

• Increased status and staff capabilities for the WIN 
central offl^ce unit * . 

• Authority for that unit to deal directly with key 
administrators and support units (personnel, pro- 
curement and computer services) in t^e SESA* 

• Development of a .cg^mpetent^ experienced cadre of , " 
\ field technician^ or area administrators to provide 
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(Da visible WIN presence in ^he fl^ld; (2) a dl- 
, rect. Informal coomiinlcatlon lljtik batweien the* WIN , 
central and aervica daliv«ry unlt9» <3) con^fnuoua 
* technical .aaalstance; (4) a monitoring system; and 
(5) a lateral communication network* ' 

. * * 

Even if tills' strategy works, operating a high pesforming WIN program in * 
an ES-lntegrated- setting may •Involve continuous' vigilance, since ev^n a « 
J'satls.factory" situation may be rapidly reversed as conditions change 
Vithln the state or the host; agency. ' . ,i 

^.Thirdly, If both these strategies fall, the. set of performance ' 
Incentives and sanctions described in >the next section -can be brought to 
.bear with full' vigor. , ' ' 

5a Incentives f or^ Change 

Oux fteld'work showed that many managers and staff In low-performing 
progrMKS had^an Inherent deslfe to do tljelr jobs well, to help welfare 
recipients. become independent, i3elf-8upport^.ng iniivlduals and td make their 
pro^raro suc'ciessfula Of ten. what they' needed was^ a clearer definition of 
"success" and some direction and assistance in achieving it* In short, in 
some cases all the incentive that* may be required is some guidance on what 
to do and how to do ita . \ ; , ^ 

In addition to these self-incentives a set of relatively, powerful 
Incentives are available to federal officials interested in stimulating" 
improved perfcopra'ance in state and local WIN programs • They include in- 
centive fanding formulas, publicity, the authority to switch WIN sponsor.- 
ships, and tfie targeting of* special initiative funds on state programs 
receptive to performance improvement- projects* These incentives already, 
operate within the program to varying extents* The^ following subs^ectlons 
indicate how they could be strengthened and focused to foster an pn-going 
Interest in performance Improvements • 

* t _ 

Incentive- Funding Formula . ' 

Section 2 proposed a procedure for identifying high and low per- 
forming programs • That same procedi^re Qould be used to modify the current 
WIN Allocation Formula, making it' a clearer and stronger incentive to per- 
formance* ThijS would Involve (1) -islmplifylng tihe formula so that its 
'^messages" about program priorities are more readily understandable in the 
field and (2) identifying explicitly that portion of "discretionary" 
funding that is based on relative state program performancea 

The mandatory portion of the formula and the bulk of the discre- 
tionary portion couid, as in the past , be allocated strictly on the basis 
of size (number of registrants in each state)* The remainder would be 
apportioned to states based on' whether they performed better' or worse 
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than expected*! given the.diifficulty of their environment* Perforoiance 
in a number of key areas (efg«» retention ratet Job entry wage rate » job 
entriee fair staff and ii«lfar* saving*) could raceiVe policy weights and 
be coobined Into an Overall effectiveness index^ fdr ^ch state program* 
The overall effecXlv^ess index for a state would determine its share, 
of the V*ef feet iveness^* discretionary funds* Since this part of the dis-* 
cretlonary allocation formula would not be affected by the siza of a state 
WIN program^ it would act as a fiscal incentive for states to maximise 
their performance in areas .consistent witH national WIM policy* 

Each staters overall 'effectiveness index» its performance in each , 
component of this Index^i and gains or losses of. *'ef fectiveness" discre- 
tionary funds would be public knowledge* This would tend to promote com- 
petition among regional and state WIN programs* N6 longer would state 
WIN programs be. uninformed about hpw their performaucw compared to, other 
states* ' ' •.. ^ ^ , \ • • 

' The proportion of discretionary funding to allocate, on the basis 
of effectiveness and the policy weight to be assigned to each performance 
.measure are policy issues to be decided by national WIN officijals* These • 
decisions would be. based in^ patt on computer simulatiotis of the proposed* 
formula using diffverent proportions of discretionary funds for the per- 
formance Incentive portion. Such s.imulations woj^ld identify the dis- 
tributive effects of different approaches* This could ml^nimize sudden» 
extreme shifts in funding among stajtes (and associated^operatlonal and 
political compli M talons) during the first year of use* The proportion 
of funds committed to the performance incentive portion of the formula 
could be increased in later years » reinforcing^ the incentive fpr- state 
programs to improv^^ their performance* * 

^ ' • * ... 

Publicity " , ' . . ^ 

' ■ - -■ ^ ' ' 

^In many case^ such a performance*^based funding mechanism may be 
incentive enough to cause improvement efforts* Further stimulus can» 
however » be .4)rovided by publicity* l^hus^^ gains and losses under the effec- 
tiveness portion of the formula should be 'disclosed as well .as the relative 
ranking of « the states and trends in those rankings* The objective* non- 
Judgmental character of the procedures for identifying performance would 
be explained, and the "automatic" character of the funding gains ,aiid loesses 
would be emphasized* 

This information woultl be disseminated not only to WIN sponsor 
and SAU personnel in each state but to host agency officials » elected 
officials and the media. The objective would be to. increase their aware- 
ness and respect for their WIN program if it was a higher ^^erformer and ^ 
to focus 80fl\e concern if it was a low one* x . 
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* 'tn the e«t« of low 6r declining perfon^eire, it ney be detlreble 
to empheelze the federeX «oney the etete ie loelng beeeuee of the pro* 
gf9M'» reletlve ineffectlvenese* The link betve^n WXM end pollt^lcel in- 
terest in the !*velfere problem" cen eleo be «ede« Uetln tUe underlying 
reeeons fofloeees can be epecifled with date from the monitoring end 
dlagi>08tic tools described earlier* 

Switching Program Sponaorehlo y 

' . ' ■# ■ • . ■ * ♦ 

If neither the fact that a low performer was losing, funding nor 
the publicity of that fact resulted in ef farts to Improve' per^armance, . ' 
federal officials could* consider switching "WIN sponsorship to another 
agency. Our findings on ES-WIN linkagee and* WIN performance syggest ' 
that ES sponsorship of WIN is not absolutely essential ^see Chapter ID* 

' A change of sponsorship would require (I) clear and convlncJ«ng 4 
documentation' of -the reasons- for the change, end (2>-«n alternatlvie host 
that was likely to be more effective. Recommendations made earlier would 
provide the necessary documentation. .The performance identification proce- 
dure described, in Section 2 would provide quantltetlve evidence of the 
program's persistent low performance relhtlve to programs in other stetes. 
It could also generate the data to refute claims^ that a more difficult 
economic (Environment qr clientele were' to blame. The regional office ooni- 
torln^'and diagnosCic capabilities described in Section 3 would, provide 
< evidence of administrative &ad operational shortcomings and qf persistent - 
inability or unwillingness to correct them. .All of this material could 
be made available to intierested politicians, the media and the public , 

Fin<^lng an alternative sponsor involves a judgment about which 
particular alternative would-be likely, to provide an .organizational environ- 
ment conducive to high, WIN performance 'in that state or 'community. That 
seems more important than the general category of . agency (i.e. SESA, welfare 
departtnent, ^CETA prime sponsor , co'mmunlty-based organization) . Part of 
the judgment would involve assessing the likely commitment of ialternative 
^sponsors' to the program, based, on their past record ^f serving similar 
cj.ients* Staff and managerial competence> in |:eieyant service delivery, 
tecfinlcal aTid administrative^ areas would have to be analyzed, as would the 
coincidence 'of WIN goals with the .goals of the possible sponsor.. That* evalu- 
ation might, in fact,^be based on the same -regional office monitoring Instrur 
'ments used to assess cur rent. hosts* < 

, • " • 

I 

* ' Like adverse publicity; withdrawal of program sponsorship may be ^ 
' Art' orgaalzationar embarrassment. The threat of It may cause desired modi- 
fications in attitudes and behtf^pr and perhaps even changes in key per- 
sonnel. However, regional and OWIN officials must be prepared for the 
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political reactions that may result Instead. Case-by-case judgments will 
thus have to be made as to whether, the-potentlal gains in a particular ' 
state are worth the possible risks to the program as a wholes 

Tarieetl'nft of Special Initiative Funds ^ . 

Additional funding for innovative, experimental or demonstration 
projects could also be used to reward high performers and encourage im- 
provement in low performers. Some special initiative projects might be 
better suited for impr^meotation and testing in relatively high performing 
operations. Others might fit within a general sttategy for improving a 
state's overall level ^f effectiveness or the performance of local 'opera- 
tions. Before such funds were given to a low-performing state program, 
an explicit commitment to specific performance improvement efforts should 
be abtained from the WIN sponsor and SAU coordinators and the top adtainis-- 
trators in their host agencies. The additional dollars could be used to 
obtain staff f<yr' the WIN central office who had skills currently needed 
but not available, to obtain technical assistance on automated reporting 
systems, or^ to cover the costs of specialized training for central office 
staff, local managers and service providers. A possjible approach- for ^--i- 
plementing performance improvement projects in low performing .WIN opei ■ 
tions is presented in the next section. \ 

6 . A Structured Approach to Improvement • 

The interrelated nature of our recommendations has been pointed 
out in the prior sections. While many of those suggestions might be im- 
plemented separately, they are. also the building blocks, of an integrated 
approach to. Improving the WIN program.. That approach could involve: 

* , ' * 

• Strengthening the evaluative and monitoring ca- 
pabilities of federal and state program staf if* 

• Revision of existing allocation, planning and 
performajioe assessment sys'tems* 

• Provision of federal assistance to state programs 
attempting to improve their operations. 

• Development of a data base on a representative 
sample of local WIN operations for vlthin-state 

•allocation, planning and evaluative purposes; for 
more precise analysis of. the interrelationships 
^raong envirbnmental factors, organizational vari- 
ables and unit performance; and as a source of 
comparison group data for future experimentation • 
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# Eixperiraentatlon in selected low performing state 
programs to determine the effectiveness and feasi- 
bility of changing organizational ^ managerial and 
service delivery characteristics in order to im« 
prove program performance • ' * - 

This proposed approach would test further the fihdings, suggestions 
and hypotheses pr*esented in this report' in a systematic fashion* ^t wbuld 
also result in a general upgrading of the skills and^ expertise of federal 
and state program staff* The performance Improvement strategy proposed 
here would be internalized within the WIN system* Federal and state staff, 
vould participate in the development of its methods procedures and ana- 
lytic tiechniques* They would collect the necessary data, maintain data 
bases on their computer systems and conduct the required analysis* It is ^ 
intended that, at the conclusion of the first wave of experimental proj- 
ects, WIN staff would be able to continue the performance improvemsnt pro- 
gram with little or no outside assistance* 

Th? basic elements of a structured performance improvement program 
are shown in Figure 13* "Design Development" would entail (1) creating 
an advisory committee of national, regional and state officials to provide 
direction and recommendations; (2) designating OWIN staff responsible for 
and involved in t\ ^ Improvement program; (3) reviewing this study and 
others to identify priority issues, hypotheses %o test and variables to 
measure; and ^(4) refinement of a design for the subsequent elements of 
the project* 

"Develop and apply allocation formula" means identifying high and 
low performing states as described in Section 2 and modifying the WIN 
Allocation Formula as recomended in Section 5* The goal of this *effort 
would be tp create a single systeuv for resource allocation to state pro- 
grams, development of planned activity goals for key performance indica- 
tors, and evaluation of state program performance* This system would take 
inio account^ the different socio-economic environments of state programs 
in determining their relative performance levels* 

This system must meet two criteria in order to be accepted by 
federal and state WIN officials* First, It must have face validity with 
program administrators. It must be relatively simple. Involve procedures 
that are understandable to personnel without extensive statistical train- 
ing, and present data straightforwardly on performance measures and the 
relative effectiveness of state WIN programs* Second, it must be con- 
ceptually and statlst,lcally sound. Fast performance-based systems that 
had conceptual or statistical shortcomings eventually succumbed to bureau- 
cratic and political attacks. Tying dollars to performance levels will 




* ■. -t.v-v 



Design 
Develop- 
ment* 



Create reprf^sentatlve 
sample of local 
WIN/SAU units 



Collect data on 
performance » environ- 
ment and regj|;Strant 
characteristics in 
sample units ^ 




Develop system for 
vlthln state resource 
allocation^ .performance 
incentlvest activity 
goals and evaluation 
of local units 







Meas.ure (questionnaire) 

organizational and 
service delivery variables 

that may influence per* 
fprmance In sample units 



Develop and apply 
allocation formula with 
clear performance incentlvea 

that takes into account 
differences in environment 



2'. : 



Develdp and* apply 
monitoring guide for WIN 
fed reps with 
indicators of state 
l^el program admlni- 
8tratlon» operation, 
priorities 



Develop experiments 
in organisational 
and service delivery 
change; measure 
effect and apply 
results generally 



Use Information 

to design and 
target federal 
TA, discretionary 
f und 8 » sane 1 1 ons , 
Improvement 
strategies 



Figure 13 
WIN Performance Improvement Program 



t>e a controversial enterprise, especially for low performing dpeirdtlons 
that ^11 get smaller proportions of the total funds,- so any new system 
Buat be ^1« to withstand critical review* 

''Developing and applying monitoring guides" was explained In Sec« 

tlon 3« Sections 4 and 5 dlsciissed the use of the resulting In^formatlon 

In targeting Improvement asslstarrce as veil as applying Incentives or 
sanctions # * ' ' 

The Items shown In the upper part of the diagram are Intended to 
permit (1) continuous monitoring of changes In enirlronment » organization 
and performance throughout the VIN system' and (2) structured performance 
Improvement experiments that^wlll permit the feasibility and impact of 
various change strategies to be evaluated. 

This would Involve t firsts creation of a stratified random sample 
of local WIN units that would be representative of all WIN units and pe- 
riodic (probably annual) collection of data on their environment » client 
demographics and performancee As shown In Figure 14el» that data can be 
use4 to create a system that would assist, state programs ^n Identifying 
high and low performance among local units an4 allocating resources among 
them. This system woul'd be similar to what we have already proposed for 
federal use with state programs. and could be developed using a similar 
methodology e Use of this system within each state would be left to the 
discretion of state program administrators.^ 

At the same time survey-based techniques would be developed to 
measure organizational variables which ^have been hypothesized to affect 
unit performance) such as those Identified In this study* Data 'on these 
variables would be collected on a periodic basis from the same sample of 
units • Together the two types of data would allow national officials to 
continuously monitor important changes in the environment, xjrganlzatlon 
and performance of WIN un^ts generally or of particular types of units. 
The Influence of policy or procedural changes in the national program on 
locaL operations could also be observed* 

In addition, these data could be used la ^analyses Important to 
the development of performance Improvement projects. Relationships among 
variables suggested by our findings dould undergo more rigorous testing 
and analysis. Cross^-sectional analy^s of data on these sample units 
could strengthen evidence about interrelationships previously observed. 
Longitudinal analysis of these data^would permit the inference of cause 
and effect relationships among these variables^i Such analyses would in- 
crease the confidence with which WIN administrators could prescribe changes 
in organizational variables and predict their intended Impact on program 
performance. 
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Next,' low performing state and#local programs Interested in Im- 
proving their operations could be identified, and performance Impro^ent 
projects could be developed and negotiated with state and reglottel offi- 
cials.' If agreement was reached, data like that collected in tjie sample 
of units Just described ,would also be collected in the local units that*^ 
were to be the focus of change strategies # Actions intended to change or 
gahlzational variable^ tould then b^vtakenv Bata on these "experimental" 
units' environment, organization and performance would be collected peri- 
odically and compared to the same type of data from comparable sample 
units. This would permit outcomes to be assessed in light* of knowledge 
of what would have happened in experimental sites if experimentation had 
not occurred. The objective would be to measure accurately whether the 
actions taken actually caused changes in organizational characteristics 
and whether changes in those characteristics ha^d a favorable effect on 
performance. 

In this way firmer conclusions could be reached about what or- 
ganizational characteristics influence WIN* performance and what change 
strategies are most effective* The knowledge derived about how to make 
welfare-employment programs more produci;ive could then be disseminated 
and applied generally. More importantly, a mechanism would have^been 
established for exploring the potential of Important Innovations and for 
continuous organizational improvement • 
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APPENDIX A 
METHODOLOGY 



This appendix addresses two methodological Issues that are im- 
portant to our institutional analysis of the WIN program — the conceptual 
structure we used to organize information about state and local WIN pro- 
grams , and the methods applied at each stage of the project. 

1. Conceptual Structure 

This setction describes the set of rules that we have followed in 
conducting this study* These rules represent a rational or scientific 
approach which we believe permitted us to accomplish the following: 

• Systematically collect information that was as 
reliable and valid as the state of the art per- 
mitted* 

• Place certain levels of confidence on our findings. 

• Identify underlying systems of relationships that 
were possible determinants of observed phenomena. 

• Use this knowledge of relationships to predict and 
to diagnose . 

As mentioned in Chapter 1, our primary research purposes were to 
describe the organization and management of WIN; identify environmental, 
political and Institutional influences on WIN program perfomance; and 
suggest ways of improving implementation of the program. To do this, a 
number of conceptual and practical issues had to be settled • These in- 
cluded: (1) the definition of terms, such as, "environment," "organiza- 
tion" and "performance"; (2) the categorization of potentially important 
phenomena within and outside the WIN program; (3) the development of con- 
structs, their measurement and their use in hypotheses; (4) the use of 
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models to guide our understanding of WIN phenomena; and (5) the choice of 
units for observation and analysis. * 

Definition of Terms 

Agreement on, the meaning of terms is necessary if Ideas are to be 
conveyed clearly. If we are to identify organizational and environmental 
factors that systematically differentiate high performing state (and local) 
WIN programs from low performing ones, we must define what "organization," 
"environment" and ^£e|f ormance" mean. We defined "environment" as all 
those factors outside the VIN program and its host agencies over which 
program personnel have no control. While these factors are potentially 
infinite in number, we limited our analysis to those thought on a priori 
grounds to have some influence on the program. The "organization" was 
defined as the WIN sponsor and SAU units along with their host agencies. 
WIN programs are often integrated parts of their host organizations. Tp 
isolate our focus on WIN sponsor units and SAU's alone would have been 
artificial and detrimental to an understanding of the program. We defined 
"performance" as the final output of WIN services, as established by na- 
tional WIN policy. The emphasis is on the relative performance of state 
and local WIN\ programs and the causes of performance dif f eretices, given 
existing legislative ^mandates and WIN national, ofifice priorities. We are 
not addressing the long-term impact of WIN on the income, earnings or 
self-esteem of registrants, or the program's impact on registrant family 
members or the community at large. 

C'ate&orlzinj^ Phenomena 

Phenomena observed within and outside the WIN program are at first 
glance incoherent and devoid of rational interrelationship. One purpose 
of our study was to give structure to them — to screen out those that 
appeared to have an insignificant influence on the program, and to. identify 
interrelationships among phenomena suggested by our data .analyses. While 
parts of this process were simultaneous, we present the entire process as 
sequential for the sake of simplicity. 

The first step was the definition of terms described above. The 
second step was to identify, label and categorize phenomena. Our specific 
research focus had an important influence on what phenomena were selected 
for study and how phenomena witViin and outside the WIN program were clus- 
tered or categorized. If the research questions had been different, some 
phenomena would not have been identified for study and others might have 
been categorized differently. For example, impact evaluations of WIN and 
other programs have traditionally excluded organizational variables or 
have given them scant treatment. Since their focus is the program par- 
ticipants rather than the implementing organizations, those studies would 
define "environment" differently than ours. 
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TafcJLe 40 presents the phenomena that we IdentlMed for study. 
It also shows the main categories ("external Influences "organization" 
and "performance") and subcategories (for example, "socio-economic" and 
"overall structure") under which these phenomena were classified. These 
categories were the result of preliminary conceptualization bjetsed pn our 
previous contact with the Wllf prog;.am, our work In other employment and 
training programs, our review of WIN and welfare-^related research^ and 
our understanding of political,, organizational and economic theory. 

Constructs, Hypotheses and Measurement 

The above categories and subcategoxles are the beginnings of 
theoretical "constructs." Constructs permitted us "^to fit categories of 
phenomena within systems 6f hypothesized relationships and to Identify 
ways of measuring those phenomena. Our three major hypotheses were ^ 

• Environmental factors ("external Influences") ^ 
have a direct and significant Influence on the 

. way In wlilch state WIN programs are organized. 

4 

• ;Environmental factors have a direct and" signifi- 
cant influence on program performance • (They 
also have an Indirect 'influence on performance, 
acting through the "organization.") 

• Organizational factors have a direct and signi- 
, f leant influence on performance • 

The measurement issue will be dealt with In Section '2 of this 
appendix where the survey and Interview data collection, instruments- we 
used will be discussed. Decision rules for rejecting null hypotheses 
and giving support to alternative hypotheses were le.ss rigorous for our 
survey and interview data than for our quantitative data. If high per- 
forming state or local programs generally shared a certain characteristic 
that was' generally absent in low performers, then the null hypothesis 
was rejected. Alternative interpretations of the obsen^ed differences 
were then examined. This process was supported by statistical analysis 
where feasible and appropriate. 

Use of Models 

In behavioral sciences the term "model" has a number of meanings. 
In our study, models were used to guide fprmulatlon and understanding of 
the dynamics inherent in the WIN program. Some were purely descriptive* 
They might show the organizational structure of state WIN programs, the 
functions conducted by managers, or the client flows in local service 
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Table 40 

o Catenorlzat lon of WIN-related Phenomena 



EXTERNAL ifJFLUENCES 



THE ORGANIZATION 



PEflFORMANCE 



Socio- Economic Envirorunent: 
Economic i labor market conditions 
Social & demographic characteristics 
Political culture 

c 

Policy: 

National program goals i priorities 
Regional Office priorities 

Incentives: 
Funding formulas 
Fiscal' sanctions 
State budget oversight 

Funding : 

Federal budget levels 
Regional use o£ discretionary funds 
State funding contributions 
Local subsidies (PSE positions & 
free office space) 

External Bureaucratic Influences: 
Regional monitoring & technical 

assistance 
Civil Service Commission policies 
Union contracts & activism 
General services 

Political, Influences: 
Policies & priorities c elected 

officials i their political 

appointees 
Patronage 

Professional associations 
Lobby groups 



tltajor Determinants 
Qpals.: 

Awareness & application of 

national priorities 
SAU & WIN sponsor goals 
Incidence of goal displacement 

Overall Structure:^ 
Program size 

Horizontal differentiation 
Vertical differentiation 



Retention Race 
on Jobs 

Job Entry Wage Rate 

Job Entries per 
Staff 

Welfare Grant 
Reductions 



Organizational Leadership: 

Demographics of top administrators 
Management functions and the way^ 

they are conducted 
Delegation of authority 
Communication networks 

Staff Characteristics: ' 
Demographics 
Work backgrounds 
Attitudes and morale 
Competence 

Work Unit Characteristics 
Work Unit Organization: 

Structure of units 

Span of control 

Client flow 

Specialization (division of labor) 
Standardization (extent of rules 
and regulations) 

Coordination/Communication: 
within WIN sponsor units 
within SAU units 
between WIN sponsor SAU units 

Interorganizational Coordination: 
WIN sponsor/SAU coordination 
with ES, CETA, IMU, Tiule XX 
Voc Rehab & CBO's 

Work Unit Management: 
Demographics of managers 
Management functions and the way 

they are conducted 
Delegation of authority 
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» delivery systems* However i another set of models was more Important %o 
our analysis* These graphically presented systems of relationships and 
the Implications of these relationships suggested by oun data analysis* 
Tliese models* accompany the presentation of findings at key points in this ^ 
report* 

Figure 2 in Chapter 1 presented a general conceptual model of 
the relationships between environment > organization and performance, thus 
graphically depicting the three major study hypotheses stated above* Fig- 
ure 14 presents this model in greater detail. It shows the constructs 
* or categories of phenomena within each component of th^ general model and 
the interactions among components* These constructs are treated Individ- 
ually in greater detail^n our report* 

Units of Observation and Analysis 

Throughout this study we have collected and analyzed data at two 
levels* At one level > our unit of observation and analysis was the over- 
all state WIN program* It included not only state level program admin- 
istration, but also local work units, host agency . influences, and external 
forces that affect the program* At another level, we treated local service 
* delivery systems as the unit of observation* We might have investigated 
local unit variables alone* But- this would have excluded state level fac- 
tors that we hypothesized might importantly influence both locat operations 
and overall program performance* Thus, data on the state as well as local 
levels were collected and analyzed* 

» 

2* Research Methods 

In this section we provide a description of the methods used in 
conducting our research* The section is divided Into 11 subsections that 
correspond to the procedural steps that we followed in conducting our re- 
search* These were: 

• Review. of relevant research studies, prograji docu- 
mentation 4nd field memoranda* 

• Creation of an interview Instrument for national 
level respondents, conduct of interviews and con- 
tent analysis of irtterview data* 

• Preparation of a survey instrument for all state 
WIN' coordinators and phone Interview format for all 
regional WIN coordinators* Collection of survey 
and interview data, Eollow-up and analysis* 
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EXTERNAL INFLUENCES 



Soclo- 
Economic 
Environ- 
ment 



Policy 



Technology 



Inccntivee 



Pimding 



Bureau- 
cratic 
Inf luencoa 



Political 
Influences, 



THE ORGANIZATION 




Nature Taake 



Overall 
Structure 



Organisational 
Leadership 



Staff 
Characteristics 



Work Unit 
Organisation 



Coordination/ 
Cosm&unication 
within S among 
vork units 



Interorganisa- 

tionAl 
Coordination 



. Work Unit 
Management 



PERPORKANCE 



Retention Rate 
on Jobs 



Job Entry 
Vage Rate 



Job Entries 
per Staff 



Welfare Crpnt 
Reductions 
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Figure 14 

Expanded Model of Environment, Organization and. Performance ^ 

Showing Components of Each 



- 

• Development of key WIN performance measurea to . '\\ 
be used In Identifying high and low perfomlng, ' 

prbgraaa and selecting state and local prQgjrams ^ " 4 

for study. 

• Development of hypothesized external Ip^luences' 
on vriN programs » Identification of soclo«*economlc 
environmental variables and data sources t An- 
alyses of these data to Identify environmental 
factors significantly related to performance* 

^ Selection of state WIN programs to be visited and 

studied t • * * 

• . 

• Development of survey and interview Instruments 
for use in sta^^s^ visited. 

• Selection of local WIN units within states to be ^ 
visited and studied* 

• Conduct of field work. 

• Detailed statistical analysis of dati on all local 
units within the ten study states. Derivation of 

path analytic models showing the system of rela- 

tionships' among 8ocio**ecanomic variables, inter- ^ 
medlary performance measures (job entries per staff, 
job entry wage rate and retention rate) and welfare 

savings. , . 

t 

• CompilaMon, reduction and analysis of ffeld work 
data* 

Review of Research Literature, Program Documentation and Field Memoranda 

As the bibliography to. this study Indicates, we obtained and re- 
viewed all available prior WIN-related research. In" addition, we iden- 
tified other studies that were conducted on jyrograms that^alt wi£h 
populations similar to thoseof WIN and studies on the welfare population 
in general. Literature on organizational behavior, program implementation 
and administration, anrf research methodology that were directly related 
to our WIN study design were also reviewed. While the majority of this 
effort occurred during the initial months of the project, throughout the 
study we maintained contacts with other researchers working oh WIN, read 
their reports and shared information on research findings. Knowledge 
obtained from this literature review was used in identifying areas for _ . ' 

study within and outside the WIN program, framing. hypotheses and refining 
our research design. 
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Program documentation and field memoranda were revlewed^'Tsi, obtain 
an historical perspective on the« program; a sense of past and currettt goals 
and priorities; and an understanding of the structure within OWIN» its 
lirikages with ETA and OHDS» and the lines of authority ^rom the natlpnal 
.office to -the regional offices and from the regions to the states. Thfese ' 
documents were Important in designing interview instruments for use at' 
the national and regional level, determining the key performance measures 
and selecting states fjfr study « 

. * 

National Level Interviews 

Twenty officials ^nd staff were interviewed at the national level. 
Seventeen- of these were in OWIN, six of whom were HEW. employees assigned 
to that office. The remaining three respondents were from the Office of 
Human Development Services (OHDS) in HEW who had WIN-ralated responSib^.!- 
Itles. These interviews focused on the following issues: 

• structure, management and linkages of the WIN pro- 
gram at the national and regional levels; 

• division of labor among OWIN staff, their role in 
policy and decisionmaking, formal and informal 
communication channels within OWIN, modes of con- 
flict resolution, and frequency and nature of staff 
meetings; 

• goals and i)i;iorlties of WIN; 

• effectiveness criteria used by national office 
staff in evaluating regional and state programs-; 

• state programs that were perceived by national 
staff as relatively high or low performers; 

• receptivity and responsiveness of regional offices 
to national offiqe directives; 

• amdunt of contact between national office and re- 
gional, state and local WIN operations; 

• history of WIN as perceived by staff — its changes 
in priorities, acceptance within DOL and HEW, etc^^; 

• areas of agreement and conflict- over WIN between 
DOL and HEW; 
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• role and influence of the National Coordinating 
Comibittee (NCC) in the WIN program; 

% attitudes of officials and staff in HEW, DOL and 
0MB, as well as in Congress, toward WIN and their 
influence on the program; and 

e^. perceived effectiveness of the DOL and HEW rela^^^ 
tionship in administering and operating the WIN 
program* 

Information obtained through these interviews provided us with 
an understanding of the administrative and authority arrangements found 
in the federal part of WIN. The interviews also aided us in identifying 
the program cpncerns of the WIN national office to be addressed in our 
study* They provided information useful in determining the key WIN per- 
formance measures, identifying state programs to be 'studied, and developing 
survey and interview instruments for use at the regional, state and local 
levels* . ^ 

State Surveys and Regional Interviews - ' 

Each regional WIN coordinator was interviewed by phone to obtain 
the following information: (1) a ranking of state programs in each region 
on the basis of their effectiveness in meeting WIN goals; (2) the criteria 
used in making such judgments; (3) the outcomes of any recent evaluations 
or monitoring of programs; (4,) 'the internal administrative and authority 
patterns within the WIN regional office and the nature of its linkages to . 
ETA and* OHDS regional offices; and (5) the existence of WIN sponsors, other 
than SESA's in the region (for example, welfare departments, or CETA prime 
sponsors) • ' 

Each state WIN sponsor coordinator was also surveyed by mail ques«- 
tlonnaire* All 51 coordinators responded to this survey.* The survey 
sollcite4 information on (1) the structure and governance of the aponsor 
agency, (2) the specific location hi the WIN program in this host agency, 
(3) Its local service delivery system structure, (4) ^whether the state 
WIN central office had line authority over local units, (5) the internal 
structure of the WIN central office, (6) thiB incidence of collocated WIN 
and SAU units, and (7) WIN coordinator pergeptions of WIN goals, prior- 
ities and key performance measures* 



♦Surveyed programs included those in the 50 states and the Dis- 
trict of Columbia. 
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I^^fofqatlon, provided by regional and- state coordinators was used 
to develop an overall picture of* how regional and state programs were 
organized and to help seleej^ states fbr fl^ld study. Analysis of this 
information also provided us with preliminary findings "on the relative 
priorities of g,tate WIN i>rogram&^ -their agreement with national program 
priorities, and the association between general^ organizational character*- 
istlcs and WIN performance levels* These findings are presented where' 
appropriate in various chapters of the report « 

Determlnatli>n of Key WIN Performance Measures ' . 

Appendix B describes how we determined the key performance measures 
for the WIN program. These measures became the criterion variables for 
our overall studyi They are used to Indicate the relative effectiveness 
of state and local programs in meetijcig national WIN goals* The importance 
of particular en^'lronmental and organizational factors for WIN programs is, 
In the final analysis, based on their association with these performance 
measures* the four performance measures used In this study are retention 
rate^on Jobs, Job entry wage rate (relative to prevailing wage rates), 
Job enLirles per sponsor staff, and average monthly welfare grant reduc-* 
tions (relative to the product of average number of registrants and average 
monthly welfare grant)* We reached a determination on these performance 
measures through interviews and consultation with OWIN officials, content 
analysis of program documentatldn, and statistical analysis of the dis- 
cretionary (performance-oriented) portion of the WIN Allocation Formula 
for a three-year period* 

Socio-economic Environmental Influences on Program Performance 

As any local WIN worker^will tell you, the prevailing conditions 
in a Job market and the demographic characteristics of WIN . registrants 
have a major impact on registrants' likelihood of getting jobs and on the 
quality of such Jobs measured by how 'long they last and wage rate* It 
ls\ reasonable to hypothesize that it would be more difficult for disadvan- 
taged workers to find Jobs in labor market areas with high unemployment 
rates or very few low-skilled Jobs» In addition to examining the effects 
of labor market conditions on disadvantaged job seekers, research has also 
shown that certain characteristics of Individuals are related to welfar^e 
status* For example, expected duration on welfare for males is, on aver- 
age, significantly lower than for females* These studies also show that 
expected duration on welfare varies considerably by the ethnicity and age 
of recipients* ^ In addition,, the level of educational attainment appears 
to have a significant Influence on the length of time Individuals stay 
on welfare* Therefore, it was reasonable to hypothesize that these demo- 
graphic characteristics also have similar Influences on WIN program per- 
formance* 
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. These and 6ther envlrdnmental differences among state and local 
programs were taken into account when we analyzed the, relative effective- 
ness of prograffls. The procedures %re used. are covered in Chapter 2 and are 
treated In more" detail in Appendix B. T'he procedures involved: (1) ' de- 
velopment of hypotheses on the Influence of certain environmental factors 
on performance; (2) statistical tests of these hypotheses using both state 
aggregate and local data; (3) development of path analysis models explain- 
ing the socio-economic' influencee on WIN performance; and (4) statistical 
adjustments to performance for environmental differences* 

Selection of State Programs for Study , 

An optimal research design for ascertaining the relative influence 
of different organizational Sac tors on program performance would have in- 
volved the random sampling of state programs to identify those for study. 
Such a sample would have been representative of the universe of state WIN 
programs — those with "high," "average" and "low" performance. 

However, budget limitations prevented us from drawing such a random 
sample of state programs and conducting field research in them. Given 
this budget constraint and the fopus of our /research effort — identifying 
wliat differentiates high from low performers — we selected a set of high 
performing state programs and* a set of low performers for study. Our se- 
lection: prtjcesa :strai:±Bncralty-adj usted iot ^tretewcr&a tn~t1ie' ehviFdnments 
of state programs. Lt also sought to creat4\roughly comparable pairs of 
programs (one high and one low performer) frqm.each geographic region of 
the country. 

Thus, at the outset there were no "average" performers among our 
study states* ttowever, one of the states that had been a high performer 
for at least two years dramatically declined during the year of our field 
work, according to that fiscal year's performance reports. Throughout 
the text, that state is often referred to as the "declining performer" 
and appears as "State E" in the tables. The perforinance levels of the 
other nine states remained relatively stable. ./ 

In addition, we included programs that had shown significant in- 
creases or decreases in performance levels during the three year period, 
for which we had conducted statistical analyses. We were hoping to iden- 
tify factors that had contributed to these changes In performance. Other 
criteria used In this selection process were the different organizational 
arrangements found in state programs. We wanted to Include in our study 
sample state programs that varied In terms of (1) presence or absence of 
line authority over their local units, (2) collocation of SAU and WIN spon- 
sor local units, and (3) state or county administered welfare programs. 
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since state selection was clpsely linked to our ajaalysls of socio- 
economic Influences on WIN performance ,*'our selection process Is discussed 
further In Chapter 2 and Appendix B. • 

• • \ 

Survey, and Interview Instruments Used During State Visits 

Informanion gathered by survey and interview instruments both 
•8viijplemented quantitative data from program reporting systems or other/ 
data bases and Aeasured phenomena not previously examined. Program phe- 
nomena that survey "and interview instruments addressed were presented 
irt Table 40 • - ^ . ^ - - ^ ^ 

; r X survey instrument was administered in those Itfcal programs 
visited. It was designed to measure organizational characteristics of 
WIN units providing services to registrants. This questionnaire was 
based on one that had been previously used in ^employment and training 
programs and that had undergone extensive validity and reliability 
testing. ' 

A semi-strucfcured interview guide was used to elicit information 
on phenomena go diverse or so sensitive that survey techniques were deemed 
inappropriate. These phenomena included political influences on the pro- 
gram, the perceived competence of coworkers or the behavior of superiors. 
0{)en-ended interviews permitted us to ask follow-up questions that. clari- 
fied and sujjhstanttated a response. V/hat evidence could a respondent cite 
to back up his initial assertion or characterization? Finally, the in- 
terviews provided "benchmarks" for the survey data. When workers in one 
unit indic<ated in the survey that they had "quite a bit" of influence over 
local office decisions, what did. that mean in actual behavior or opera* 
tiohl Was that comparable to the same 'response by workers in another 
unif? . . - . , . 

Survey and interview instruments were field-tested and modified 
to improve their accuracy and clarity. Experienfced field researchers 
were used in. the field workVv They were trained 'not. only on interview 
techniques but also on the content of the instruments, the purposes for 
specific questions and the future use of the data. 

Appendix C contains the outline of the interview guide used in 
the field research phase and the type of respondents interviewed in each 
state. Respondents were asked different questions depending u^on their 
organizational affiliation, personal responsibilities and governmental 
levfil .(federal , state or local). A number of respondents were asked the 
sarat> qbestlon in each location visited^ permitting cross-verification 
of responses # 
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Selection of Local WIN Unlta for Study . ' ' . \ ' j^- 

*Our procedure for selecting ^ocel study units 4As similar to our 
slAte selection process. Due to budget constraints, we did tt«>1?, randomly . ' 
sample units. We selected local units that statistical analysis showed 
were either high or low performers within their states. 

» 

In seven of our ten study states, there were a sufficient number ^ 
of local units to permit meaningful statistical analysis of local unit' 
performance and socio-economic environmental data. This analysis per- 
mitted us to statistlcaUy adjust* for differences in local socio-economic 
environment as we assessed relative performance of local units* 

In selecting ampng possible study units other criteria came i.p^to 
play. We wanted a set of offic*es representative of , metropolitan, suburban 
and rural operations within the state. We also wanted examples of WIN, ^ 
sponsor-SAU collocation and local service delivery experiments. • 

When we entered a* sample state we had already Identified a set of 
units for possible study through our analysis. During the' first day at 
the state central office, we discussed our choices .with WIN coordinators 
and their staff. In all cases these individuals found Tour identification 
^of'high performing local programs and low performing units consistent with 
their own assessment. Adjustments were rarely required >n our sample of » 
local units, although idiosyncratic considerations like the absence of the 
manager or. the presence of a..regional review tekm occasionally affected 
our final selections. Each of the 43 local .of fices visited, therefore', 
were high or low performers relative to other < of fices in. the same state. 
As is discussed in Chapter 2 and Appendix B, however, statistical analysis 
of data from all 214 local offices in the ten states revealed that some 
of the offices that were high or low performers .within a given state, were, ' 
in fact, "average" performers compared to offices across all ten states. 

, >* 

Conduct of Field Research • ' . 

■= . • 

Table- 41 present^ the total number of local WIN units tin each 
st'udy Istate and the number w6 visited. Overall, we conducted field work 
in 43 local WIN units. In most of the dtudy states, teri* staff days of 
field work were conducted, but several of the larger states r.equired 15. 
On average, about 40 individuals were "interviewed at the state, area ^nd 
local level in each state. These in-luded WIN sponsor, 9AU, SESA, welfare, 
ES and CETA personnel. They. ranged from state' agency directors to local 
service deliverers. If an Intermediate area administrative layer existed. 
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Study State 
1 

. 2 
3 

V 4 ' .. 
5 
6 
7 
8 
9 

10 



• .Table* 41 
Unlta In Study State. Proftrama 

Total Number of 
, . ^Local WIN Programs 



20 
*18 

VI 26 
6 
10 
27 
' 4 
13 
34 
214 



Number of Local 
Pnlts Visited 

7 

5 

4' 

. 4 • . 

' 2.. ■ ; 

■ -1 • • 

A3 



r ~ ' — • 

area staff with responsibility for .local units we visited were Intervt^jved. 
Wher? possible,' we also Interviewe* state budget of flee ^r legislative 
staff familiar with WIN* Respondents w^re promised that their identity. > 
and^thaf of their site and" state would be kept confidential. In total, 
'430 individuals were, in^ryiewed: 

, ' . 19 WIN, ETA and OHDS Regional Office staff ' ' 

123 staAe personnel (state and area level 
' WIN sponsor, SAU, welfare, SESA»>and CETA 

* . staff > • ' % •• , 

,22-3 ^local' WIN -sponsor and /'SAU staff 

63 'local '^non-WIN^p^reonnfc>l (ES, IMU, CEtA, - 

"vocational .rehabllljtatipn and other com«-. 

^ ' • munlty based organljzations) 

430 total ■ 



. Statistical Analysis on Local Utiit.» Envij^ronmental and Program Data 

Our local un^t selection process resulted in a comprehensive data ' 
base .on all 214 ipcal units lA the ten study states. ' This data base in- 
cluded WIN and SAU program data*' local lebor market characterisjiijcs, demo- 
graphic and social indicators fpr the service areas covered by WIN linits, 
and demographic data on WIN registrants. ^ 
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Multiple regression analyses were used on this data base to iden<- 
tify possible systems relationship among socio-economic environmental 
variables and WIN performance measures. Statistical procedures tested 
%ihether the assumptions underlying the analysis were being violated* These 
tests and our statistical findings are briefly presented : in. Chapter 2 and 
in greater detail in Appendix B* The final outcome of these analyses was 
* the development and testing of path analytic models that dhow possible 
relationships among environmental variables » intermediary performance 
measures (retention rate on Job» Job entry wage rate and Job entries per 
staff), and welfare savings. 

This process also permitted us to evaluate the program reporting 
systems being used In state WIN programs and assess the validity » reli- 
ability and accuracy of reporting categories as well as actual reported 
data* Problems which were identified ar^ addressed in Appendix B and 
in Cliapters 2 and 14. of the report. | 

We also tested associations between WIN sponsor performance vari- 
ables and SAU activity variables and relationships among the performance 
variables themselves.' Findings from this analysis should be useful in 
revising planning, evaluatioti and allocation procedures. "ThGy should 
'also help in incorporating SAU data into qfn overall WIN reporting and 
monitoring system. 
-> 

Co mpilation^ Reduction and Analysis of Field Work Data 

' — ~ — • — " — ■ — ■ ■ ■ — ^ g 

By the conclusioi. of the field work phase, all survey and inter- 
view information had unde'^vj ;ne preliminary processing. Survey question- 
naires had been reviewed and coding corrections made where necessary. 
The coded data were keypunched and a subfile created in our computerized 
data base . ' 

Similarly, interview Information had been coded by' type of re- 
spondent and response subject,. To f^^cilitate file creation and content 
analysis, the response of each interviewee to each question had been re 
corded on 5x8 index cards. These cards were filed by scate, local unit 
and. subject. When more than one subject was covered by a response, the 
card was cross-coded, and xeroy. copies^ were filed where appropr'iate . 

The contents of interviews were analyzed manually by subject area. 
This Infprmativon w&s then examined to, ^^entify categories of responses. 
Categorized responses were then compared across units and states. Com- 
^parlsons were also made to state or local performanca levels. Patterns 
were thus identified. Additional analyses were cc(nduc ted using quantified 
program data when available* v . 
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i Survey data were analyzed by IomI unit using computer printouts 

of individual responses and unweighted and weighted aggregations of re- 
sponseej. Cross-tabi lations and statistical analyses were conducted, to 
test hj^potheses and to elucidate patterns that appeared to exist among 
study variables. 

/ In the end, we had three different types of inforraatipn to ,ainalyze: 

<^(1) quantified data from program reporting systems and other national and 
state sources; (2) pre-categorlzed measures of local unit characteristics 
from survey. questionnaires; and (3) categorized, qualitative Interview 
data on a biroad variety of state and local organizational, procedural and 
fmictional variables. 

From our analysis of state program and socio-economic quantitative 
data, we can make Inferences that hold for all state WIN programs. For 
example, findings relating to the anfluence of socio-economic environ- 
mental factor s on state aggregate WIN performance can be Interpreted with 
high levels of confidence. They l.nfer what probably is the case across 
all state WIN programs. 

The results of our analysis of local performance and socio-economic 
environment must be viewed more cautiously. As stated previously, we were 
unable to draw a random sample either of state programs or of local units. 
Therefore, while high levels of confidence can be placed on our findings 
abour relationships among local environmental and performance variables 
in the ten state programs studied. Inferences to the universe of local 
WIN units must be modified by the degree .to which our 214 local units are 
representative of the universe of all local units. However, data on all 
local units in the ten states are probably represantatlve of those local 
units found in high and low performing state programs. 

Data on those local units visited (43 of 214) in the ten study 
states also must be interpreted with caution. We had originally hopeJ to 
use surveys in all offices in our ten study states or in a random sample 
of those offices. This would have provided measures on organizational 
variables that could have been used in our quantitative analyses and re-* 
suited in statements of statistical Inference at least about the universe 
of offices in ten titates. However, funding for this component of the 
project was not made available. 

We believed that the survey and interview data reliably and validly 
describe phenomena in the offices we visited. Wlille we do not claim' that 
these units are representative of all offices, data and analyses presented 
In Parts III and IV of the report do provide strongly suggestive findings 
on what differentiates high from low performing state and local WIN pro- 
grams. On a number of important dimensions, there are consistent, clear 
and systematic differences between high and low performers. 
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APPENDIX B 

SOCIO-ECONOMIC IMFLUENCES Oil WIN PROGRAM PERFORMANCE-- 
CONCEPrUALIZATION> STATISTICAL ANALYSIS AND PROCEDURES 



This appendix presents In greater detail the general discussion 
of environmental influences on WIN program' performance found In Chapter 2 
It Is subdivided lato five section?. The first focuses on the conceptual 
framework that guided our research on environmental and organizational 
factprs Influencing WIN program implementation. The second describes how 
we identified *key WIN performance measures—the dependent variables in 
our study. Analysis of state-*level aggregate data on environmental and. 
performance variably is treated in the third section* This is followed 
by a section oh our analysis 6f data on 214 local WIN units in the ten 
states studied. The concluding section considers areas where the general 
approach presented in this appendix could be further refined and could 
be used in longitudinal research to statistically infer with greater pre- 
cision cause .and effect relationships among environmental, organizational 
and performance variables. 

1 . Conceptual Framework 

•Chapter I presented the general hypothetical model that is at the 
core of this research effort. This model is reproduced here as Figure 15 
Subsequent chapters of the report expanded upon this models-fleshing out 
the variables of l.iterest that made up each of' its component parts. How 
thl? model was used to guide our analysis of socio-economic Influences 
on WIN performance levels is the subject of this section. It also de- 
scribes how this statistical analysis of environmental and performance 
data was used in exploratory research on the organizational determinants 
of WIN program effectiveness. 
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Figure 15 

General Model Showing Hjy^otheslzed Relationships 
AmonR Environmental* OrganlaSatlonal and 
Perfortnance Variables 

In essence 9 the model hypothesizes that program performance levels 
are determined and moderated by environmental and organizational factors* 
The environment encompasses factors beyond the control of the. agency Im- 
plementing the program. These Include (1) labor market conditions^ (2) 
soclo-demographlc character Is tlcB of the catchment area's population and 
of WIN registrants^ and (3) political and bureaucratic forces external to 
the program* Internal organizational factors cover administrative and 
structural, aspects of WIN programs > managerial characteristics ^ service 
delivery procedures, Intra-and lnter->agency linkages, staff characteristics 
and the like. . 

' The relationships hypothesized in Figure 15 can be depicted by 
the functional statement. 



Y 

where Y 



L 
S 



P 



f (L, S,.P, X) 

a measure of overall WIN program performance 
or a vector of a number of performance indi- 
cators 

a vector of labor market factors 

a vector of socio-demographic characteristics 

of the general population and of program 

participants 

a vector of bureaucratic-political forces that 
are external to the program 
a vector of organizational characteristics 
that de«:ribe the agency or agencies imple- 
menting .WIN. 
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Hovever, this functional relationship only indicates that^ performance (Y) 
is determined In some unspecified way by a set of environmental variables 
(Lt S and P) and by internal organizational factors. Specification of 
hypothesized systems of relationships can be accomplished through the 
use of path models* Such a model is presented in Figure 16 « For the 
sake of simplicity, the environmental ^variables (L, S and P) are Subsumed 
by the variable Z. Organizational and performance indicator factors re- 
main defined as X and Y, respectively* 
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Figure 16 

Simplified rath Model of 'Hypothesized Relationships 
amoHR Environmental (Z)> Organizational (X) and 
Performance (Y) Variables 



/ 



Environment (Z) l^^shovm as having a direct effect on the organi- 
zational characteristics (X) of the agency IrapleiSent Ing the WIN program, 
a direct effect on program performances levels (Y), and an indirect effect 
on performance through the intermediary organizational characteristics* 
Organizational variables are shown having only a direct effect on program 
performance levels. Other notations in Figure 16 identify path coeffi- 
• cients "( the p's) and residuals (the R's^. Path coefficients indicate the 
direction and strength of relationships between variables; residuals, the 
variance left "unexplained" by regressing one or more variables on another- 
•A more detai ' -\ discussion of path analysis and its contribution to re- ' 
search of this kind is provided in Sections 4 and 5. 
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The. model presented In Figure 16 now permits us to refine the 
previous functional « relationships as a hypothesised system of equations^ 

X • p Z + p R 
xz '^xu u 

* 

Y»p X+p Z + p R 

•-yX ^yz ^yy y 

The above path model and e<[uations present an hypothesized system of rela* 
tionships that could be tested* given certain conditions • These conditions 
include the following: 

• Sufficient information on environmental - (Z) and or- 
ganizational (X) factors likely to influence WIN 
progrcim effectiveness (Y) based on prior research, 
field observations and theory so that variables could 
be identified for study and reliably and validly 
measured • 

• Development of measuring instruments that would permit 
quantiiE icatlon of organizational phenomena capturing 
interna^lly consistent variables and using terminology 
and scales that would reliably and validly iqeasur^ ' 
these variables' in diverse settings and reflect as 
closely as possible their "real world" variations* 

• Sufficient number of randomly sampled observations 
(state and local WIN operations) upon which parameter 
estimates could be made at , acceptable levels of reli- 
ability and precision given the number of variables 
included Jn the hypothetical model* 

• . Measurement and analyses of variables over tim^.. 

so that changes in environmental and otrganizational 
variables could be related to changes in WIN effec- 
tiveness levels* A single point-in-tirae (cross- 
sectional) analysis does not permit inferences about , 
causation* A longita^^inal approach does** 



*Cross-sectional research reveals co-occurrences, which can be 
used to strengthen logical arguments for hypothesized relationships* 
Causation classlcially is demonstrated by experimental manipulation of 
independent variables while observing changes in dependent variables* 
It can also be inferred by observing naturally occurring changes in 
the Independent variables and relating these to simultaneously measured 
changes In the dependent variables* 
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• Verification that assumptions ^derlying multivariate 
analysis are not violated. These Include tests for 
non-linearity, multicolllnearity, heteroskedastlclty , 
normal distribution of residuals and their nonasso- 
clation with -predictor and dependent variables, and 
\ the like. 

As Appendix A indicated, not all of the above conditions could 
be satisfied at the outset of our study of WIN proglaos, especially those 
pertaining to organizational variables. *" Sufficient' information did ex- 
ist on hypothesized and observed relationships between socio-economic 
environmental factors and program performance (e.g., the quantity and 
quality of unsubsidized Job entries).' Such evidence was provided by 
research on other employment and training programs.* Variables were 
well-defined and comparable data on state and local labor markets and the 
soclo-demographics of their populations were readily, available from na- 
tional and state sources. Thus, we could statistically relate these envi- 
ronmental conditions to WIN performance levels, at least cross-sectionally 
and over several years for which performance information was available. , 

However, the same could not be said for organizational variables 
(those making up the X vector in our hypothetical path model). As stated 
in Chapter 1, riesearch had not been previously conducted on these variables 
in the WIN program. Our only guides on these variables were our previous 
study of ES implementation structures and theoretical models posited by 
organizational behaviorists and others. This theoretical literature 



♦Examples of sf ,h studies are as follows: Curtis C. Aller, 
Ramona K. First, DonaJd Mayall, John Mitchell, and David Roberts, "Labor 
Market Variables Affecting Employment Service Productivity," Center for 
Applied Manpower Research (CAMR), Berkeley, Callforni'a, 1974; Charles K. 
Fairchild, Development of Performanr.e Standards for Employment Service , 
Volumes IIA and IIB, E. F. Shelley & Co., Washington, D.C., 1975; 'Fred 
Eng lander. An Evaluation of the Allocation of Funds Among State Employment 
Service Agencies . New Jersey Department of Labor and Industry, 1975; "Guide 
for Application of Resource Allocation Formula (RAF) for Fiscal 1977," 
United' States Employment Service (USES), Department of Labor (DOL), 1976; 
"Handbook for Applying the Resource Allocation Formula to Measure Bnploy- 
ment Service Performance and" to Allocate Title III E? Grants to 'States 
for Fiscal Year 1978," USES, DOL, 1977; and Resource Allocation Formula 
for Fiscal Year 1979 working papers (unpublished) for "Productivity Ad- 
justed for Labor Market Factors" calculations, Westat, Inc., 1978. 
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provided some guidance. It assisted' us in developing a list of variables 
that together capturev many of the phenomena associated with organiza- 
tional dynamics. But it did not facilitate the winnowing down of these 
variables to a limited few likely to influence an organization's effective- 
ness. This was because there wa.s a lack of consensus in the literature., 
Different camps of theorists focused on different aspects of "organiza- 
tions," stressed different sets of determinants^ and adyocated different 
analytic approaches. Furthermore, these theories had undergone few em- 
pirical tests, and "testing" was often iimited to observations made in 
a single firm or a small set of firms, in short, there was little agree- 
ment on key organizational variables, and different ways of defining and 
measuring these variables existed. 

As a consequence, our inquiry on organizational viariables influ- 
encing WIN program effectiveness was exploratory .- A major objective of 
the study was to describe organizational dynamics found in WIN programs ' 
and to identify those key organizational variables that appeared to be af- 
fecting program outcomes. It was our judgment that a reduced set of such 
variables could not be Identified accurately defined or parameterized 
P^^°^ to field work. Thus, "identification" involved (1) gathering In- 
formation rn an extensive list of variables describing state and local 
, programs, . 1) a posteriori refinement of WIN organizational indicators, 
(3) categorization of the extent to which they varied In k.lnd and inten- 
sity among programs studied, and (4) content analysis associating ^these 
variations with variations in program performance. ' 

Consistent with this exploratory approach, we used semi-structured 
interviews to obtain information on organizational characteristics. These 
were supplemented by questionnaire data on a limited number of variables-- 
variables generally recognized as important in organizational studies. 
We also chose to conduct intensive research In a limited number of state 
(ten) and local (43) WIN programs rather thanamore cur ity Inquiry in 
a greater number of sites. The reault was a more In-depth understanding 
of state and local WIW organizational characteristics. Import^ilVvariables 
were less likely to escape our attention and variations among programs 
were identified j^n greater detail. 

To maximize'ithe likelihood of identifying organizational charac- 
'teristics that differentiated high from low performing WIN operations, we 
selected state programs to study only from the two ends of the perform-- 
ance distribution. Average performing state programs were not selected 
for study. - Similarly, we conducted field work In only high and low per- 
(^forming local operations within each of the study states. Thus, state 
and local WIN programs studied were not randomly sampled. Inferential 
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rigor was traded, off for more la-depth aaalysis/of two aeta of programa-- > 
one consisting of high performing programs and the other of low performers* 

Our tvo«»foId approach— one involving statistical analysis of 
socio-*edonpmic environment and performance and the other; a qualitative 
exploratory search for .organizational factors differentiating high from 
low performing WIN programs— is depicted in Figure 17 • 
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Figure 17 



Tvo-Fold Approach — One Statistical, thft Other 
Qualitative — to Explore Environmental and 
Organizational Determinants of 
Program Effectiveness 
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The top half of the figure presents a model where labor m^rk^t Ci^) 
and soclo-demographlc (S) variables are -regressed on WIN program perform- 
ance levels (Y). Each environmental vector (L&S) Is shown as an unmeas- 
ured > scaled score derived from a number of rae^asured variables, (the lower 
case I's and s's). This convention Is used to\slmpllfy the presentation 
of the approach* Our actual analysis Involved the regression of these • 
measured variables (^he I's and s's) on WIN performance measiyresJ* Co- 
variation between labor market and soclo-demographic variables Is shown 
as (and Is assumed to be) sp^ur lous ''and noncausal* The residual (R ) Is 
the variation In performance not directly attributable to labor market 
or soclo-demographlc variables* This ''unexplained" variation Is assumed 
to be due to the Indirect effects of the socio-economic environment on 
performance, bureaucratic and political Influences, the direct effects 
of organizational variables, other non-rraeasured effects, and random meas- 
urement errors • The residual term Is shown as uncorr^lated with predictor 
variables. WIN program performance Is shown as a 'single vector, Y. The 
^definition of this dependent variable and Its ^decomposition Into a numbex: 
of indicators consistent with national WIN policy Is treated In the next 
section. . 

Regression of socio-economic variables on WIN performance indi- 
cators took the form of: 

\ 

J = 1 R— 1 



*We chose a strategy of disaggregating soclo-demographic and labor 
market^ variables In our analysis rather than aggregating their Influences 
Into a single, complex variable. In this way, we could better "under- 
stand" the Individual relationships between particular environmental fac- 
tors and performance as well as their T:orabined Influence on performance. 
We were also less likely to include variables in our analysis that were 
not logically associated wlfh performance or .that were components (or 
endogenous measures) of the variables under study rather- than possible 
causes, (Otis Dudley Duncan, "Path Analysis: Sociological Examples," 
A merican Journal of Sociology , 72:1, July 1966, pp. 7 and 10.) 



27-0 



r 



9 c 



where for the 1th state (or local) WIN program 
- a WIN performance indicator 



the jth variable describing the state aggregate 
(or local) labor market 



S " the' kth variable identifying socio-demographlc 
'Characteristics of the population in the catch- 
ment area and of WIN program registrants (for 
statewide or local programs) 



*e^ - the 'residual variation. 



Data was analyzed for 51 state WIN programs and 214 local WIN operations 
in the ten states studied. Procedures followed in this analysis and our 
findings are reported in Secti9ns 3 and 4 of this appendix. 

The, bottom half of Figure 17 presents the hypothetical model we 
used in analyzing the qualitative and quantitative information gathered 
during field research in ten state and 43 local WIN programs. We attempted 
to identify "possible associations between socio-economic and political 
variables (Z) and organizational factors (the X's), indirect effects of 
environmental variables on WIN performance, and the influence of organi- 
Jsatlonal characteristics on program performance. Program performance (Y*) 
shown in this 'part of the figure was defined as the degree to which actual 
perfqmance apprpached or exceeded the performance level one would expect 
given a program's socio-economic setting. Testing this hypothetical model 
involved content analysis of interview and questicnnaire data.' Therefore, 
statistical notations are not included in thij portion of the figure. 
However, we did use simple bi-variate , correlation^ to simplify the presen- 
tation of observed associations, f^ese- correlations were supported by ex- 
amination of scatter diagrams and by the use of mpving means (the average 
value on the ordinate axis for eaco so.alar measure on the abscissa). The 
results of these analyses are provided in Parts III and IV of the report. 

The two separate analyses portrayed fn Figure 17 converge at 
Y*-- -the point whefe actual performance is compared to potential pei*form- 
ance (the performance one would expect ^or a state or local WIN operation 
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given ita socio-economic envlronmeht) Potential performance on a par- 
ticular indicator was estimated by a regression equation containing the, . 
environmental predictor variables developed by the first (statistical) ^ 
type of analysis. This "expected" performance level was then compared, 
to actual performance to provide a measure of effectiveness for the sec- 
ond (qualitative) type of analysis. ' 

the validity of this approach was* dependent on the patterns of' » 
association found among environmental, organizational and, performance 
indicators. If a particular set of environmental variables were directly 
related to both organizational and performance variables, then any associ- 
ations between these organizational and performance variables would be - 
spurious. In such a situation, one could not suggest that these organi- 
zational characteristics influenced the performance levels of. WIN programs. 
For example, if population density and, proportion of workers in low wage 
Industries were associated with performance .and also related to certain 
organizational characteristics, then any observed relationship between ^ 
these organizational variables and, performance could be spurious. 

'>Iowe\/er, if certain socio-economic factors were directly related 
to performance but shbwed no association with measures of organizational 
structure or behaviot and these organizational factors were in turn di- 
rectly related to performance levels, one could suggest their possible ■ 
causal influence on program performance. 

I* 

For this reason. Chapter 3 examines in considerable detail possible 
patterns of association between external political/bureaucratic conditions 
and. organizational characteristics ,' and between these political factors and 
program performances. Similarly, Parts III and IV. of the report^ analyzed^ 
organizational factors a'tjd their possible associations with socio-economic 
variables. and performance levels. In both cases, our qualitative analysis' 
did not Identify systematic relationships between environmental variables 
(that were significantly related to performance leviels) and organizational 
characteristics. Organizational factors and performance did not have a 
common set of environmental determinants. Theref6re,- associations between' 
organizational variables and performance (presented In Parts III and IV of 
this report) are not likely xo be spurious. Thus, they suggest possible 
causal linkages between organizational factors and program performance 
levels. " • ' 

The exploratory nature of dur study and the way in which sites ' • 
were ^elected for study does not permit us to Identify the combined In- 
fluence of organizational factors on performance. Thus, the strength 
and ^lirec'tion of such Influences aie necessarily described by^lveriate 
correlations. Section 5 of this appendix Indicates how one cotild now • 
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address these comblnied IniEru^nces and identify the rel{itiye significance 
(as measured by regression coefficients) of organizational factors as de- 
teroinanta of performance, Thus; this exploratory effort lays, the ground- 
work for more rigorous analysis of organizational determinants within state 
and local WIN programs.-. It provides a knowledge base on environmental, 
organizational and performance variables and their likely interaction that 
did not previously exist. This study ••ould assist those interested in 
efficient, reliable and valid" quantification and analysis of WIN organiza- 
tional characteristic's. Its findings suggest a system of relationphips 
that could be furtVier tested and refined through the use, of randomly se- « 
lected WIN unita, standardized questionnaires, cross-sectional analysis, 
simuikatiovis aiyl experimental manipulation of variables aimed at improving ji 
•program performance. 

Performance Indicators for WIN ^ . 

This section focuses on what is meant by output or performance 
,ln the WIN prograia* It describes how we Identified the key'perf ormauce 
Indicators for WIN'and how they were utilized in our study to identify 
organizational characteristics tha,t differentiated high from ow perform- 
ming state and local WIN programs • 

Performaince measures have played -a central role as criteria through- 
out this study. They served as the standards by which organizational 
characteristics were Judged efficient and effective • Adjustments in them 
were used to reflect the impact of environmental factors on program opera- 
tion and.o^utpat* And they provided the'basls^ for selectlng state programs 
for intensive study* • . 

The redviits of our analysis of WIN performance measures presented 
in t]Kls section address two quesfiions:' 

• What Indicators are used to measure — and reward— 

- performance in the WIN program? , ' w 

• • Which of these indicators or measures are most * 

emphiislzed and most heavily rewarded? * 

'Sections ^^3 'and 4 of this appendix use these performance measures -in iden- 
tifying the impact "of environmental factors on state *and local WIN pro- 
gran} performance* they also describe the process by which state and local 
programs were selected for field work and analysis. 

/' " ■ ' ' ' 
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Program Goals > Priorities and Performance Indicators * / ' . 

* ' The go^ls of a prograpi can bj?^peratlonalized through progranr * 

per ' !aam:,e o*r output meas^ijj^es^ TheF'goals tnajj' then be prioritized by ^ 
th$ policy or budget emphases -g^y^n to the different' indicators^ , , 

• * ^3» > 

Goals and relative prloiMtles maj;^ be communicated via verbajL and 
written messages iiellvered through planning and budget sessions » field 
memoranda and other p'^ogram documents* These channels state the general 
emphases of the program, wha^ac tl^itjLes should receive priority in serv- 
ice delivery, the monl;*)rlhg tWTshouid be done^ and the kinds of Infor- 
mation that should ba.. reportedly However, ]f>rloritles communicated may not 
be clear to program -operatdjcs In the field, or they may shift frequently, 
leading to the perception that/*ve. have so many priorities thaV we have , 
none#" ^ ^ > . ^ • 

Priorities can be communt.cated more clearly and precisely through 
a resource allocation process* Collars are directly linked to^ certain 
results, such as Job placements or welfare grant teductloris* If the allo- 
cation formula and process are understood, they tell state programsi what 
performance measures are Important and also 'their relative priority, in • 
terms of which p^ ^fQtmance indicators yield the greatest dollar pdybffj# 

/ - ' " ' 

Both policy stat-ements and allocation messages are ubSd in the WjN 
program to establish goals and priorities* Since Its inception in 19.67, 
the WIN program has been conperned with provldltig employablllty servic^g-^ 
and job opportunities to el jglble^welfare recipients* The intention is* 
to Increa^ the economic self-sufficiency of recipients and diecrease wel-^ 
^f are' costs for federal and state governments* In a general sense, thesQ / 
are the objectives of WIN, ^and to the degree that a state' progr'am achieves 
them, it is either a high or low performer* But which' Indicators/ measure - 
achievement of these objectives, and what is their relative priority? 
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T6 identify the key WtN performance measures, we interviewed Na-t 
tional Office WIN administrators and staff, reviewed program documents 
and field memoranda, surveyed regional office and state WIN coord in^yi^rs , 
and analyzed the WIN Allocation Formula* In. the following subsections ^ 
we treat' the allocation messages first, because they are most, suscep- ' 
tible to /objective analysis and interpretation* The priorities Identl- * 
fled through analysis oZ the UIN- Allocation Formula are then compared 
to those expressed in writt** . policy^ statements— National Coordinating * 
Committee (NCC) oper*^.tlng tremos , the WIN Operational Planning and' Rfeview 
System (OPRS)., the* WIN Handbook and the explanatory material alrcompan*^- • 
tng the WIN Allocation Formula. - ' * * . ' 
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. ,^. These two sources o£ evidence on goals and priorities are then . 
.' GoiBpared to two other, less formal but Important sources of evld'ence* 
One is the percept Ion of DOL and'HEW adminfatr iters and staff, about jiro- 
gram goals and their relative importance, as gleaned from interviews in 
the National. Of flee. The other is information fro% a mall survey of state 
WIN sponsor coordinators Which Included, questions on program performance 
measures, and their relative Importance. Taken togejther, these comparisons 
reveal the degree of goal. consensus bet%reen the National Office and prograM^ 
operators in the field as well as the degree of consensus between program 
administrators' perceptions of priorities and those actually operatlon- 
«allzed and rewarded by the allocation process. ' 

/' performance Factors In the WIN Allocation Formula > ^ • 

. =The WIN Allocation F^ormuia is really two, separate formulas--a 
mandatoty allocatl<iji formula and a discretionary one. As req<»lred*by 
law, the mandatory portion of the lormula allocates^SO percent of the 
new WIN appropriations t6 regions and their state pfogtains on the basis 
of "neW," that Is, on the basis of each state's share of tJie national 
• V potential WIN registrant population^ This Mandatory formula do^s not 
take Into consideration program performance.' Allocations under It do 
not reflect the relative effectiveness or efficiency of WIN programs. ~ 

.« Therefore, our analysis fpcused on the discretionary portion of 

the formula; which allocates funds among states partly on the basis of 
comparative program performanc^e*. . This part 'of the formula distributes 
to regions and their state programs the remaining 50 percent of new ap- 
propriations plus carry7ln fund's from the previous fiscal year (FY). 
Our analysis was done using the WIN Allocation Formulas for FY 1976- and 
FY 1977. Slight changes were made In the formula for FY 1978, but it 
remained basically the same as In^ the 'previous two years.* 

How well each state performs relative to the others in eight pro- 
gram areas .plays a role in the discretionary allocation to each state « 
The total discretionary^amount given to each region is the sum of the 



*Most of the quantiatlve analysis and simulations discussed here 
were completed prior to the release of the WIN Allocation Formula for 
FY 1978^ However I we have included FY 1978 data in our analysis of per- 
formance factors and discretionary allocations where such inclusion was 
both feasible and appropriate. 
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computed *Uoc«tloi« for all t>e seatM within the region. Tho Nafcional 
Offl^ca pr«tnt. tho tt.tt •UoJtUont to oach roglona officrji .^422!: . 
tlont only. Bach rogional offlc. haa the authoStJ^ SS^tSL^Stn. 
regions do not have to allocate fund, to etatea on^Se ol^he 

oT:ie'Jro1r::/"'''^""'"* •'-'^-•"^ the goala' and'p'Jlo'Juie. 

t«il« rS^^l!*?'^*?^'* discretionary portion Of the WIN Allocation' Formula 
tells regional and atati WIN coordinators which objectives and n-rf^rm-i!- 
ijeasures are Important In WIN and how they shouirhe"anked St StJlcSnr * 
differential welghta to the different perLrmanc^ todlcatora. ^^^^^^^ ' 

to atater ^""jrio^Hnl!!^"!? criteria for allocating funds ^ 

«nr! doing, they also may be changing the message on perform- 

ance priorities going out to stiM:e8. Thus, i,n aone regions state ml 
aom!5^f A^L^^ maximizing on realonal performance prISmJes ^Jat are 
jn^nVNJ .""^"'/"f national priorities. HowevL, we \«re Interested 
In identifying national performance priorities. Just as ouroverall s^^v 
^ci«?r5'!?f^ JD" 'yP"" °* orgaSiaations ind linages thIt Seie 
S«r!J^to^'^ efficient and effective attainment of nat lonai^;!l« ! 
Therefore^. our analysis of the WIN Allocation Formula foI^Sii^rfhr?!- 
tional suggested allocations rather than actual allocatlonslade by rr 

• Figure 18 presents the discretionary formula in mathematicAl form 
As can be seen, it Is n'eithcr straightforward nor. easUy^c^preSe^^^^ 

IS Uas^ soie Tcllrl^ P^S'^^^/^iyity t»»at WIN managers and staff have 
"n^^ifnt:/ % * general sense. -these could be called 

performance factors." Other factors are really "glvens." that is tLv 

^Sere'fo^e'Ll'''""^ '""^ P'°«^^ Uttle'dir'ect JiflSence oi. '?^ey 

J!^J" parameters on what could be expected of a program, ^ese ^ 

r;e as fol^oL"' "parametric factors." The eight. ?orSula fac^^r" 



nroor.™ Ta *'°"''^®» congressional appropriation for the Wtn 

llJ^i^ and carryover funds for each fiscal year are "factors" in de- 
termining discretionary allocations to states. In Figure B. 4 thLr«ro 
subsumed under the variable "X." i^igure B.4. these are 
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WGR 
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• Achievement of PotenCUl 

COQpOM^t 



^Aiere: « • ' 

Vi ■ dlacrctionAry allocation for each fltote WlN^progrem - 
X national discretionary allocation for a particular FY 

w avorflgo monthly wclfnrc Rraut reductions (AMWGR) for each etete program 
B£.« number of Job cntrlcR for each ptoRram ^ 

C£ « average Job fntry wage rate for each program ^ 0 , • 

Di « average retention rate on Jobs for each program 
Ei ■ "potential" WIN registrant* for each program 

« average monthly welfare grant^CAMWG) for each atate 
0^ • annual dollar cDat of each state program 

• penalty rate for ppor reporting for each program 
936 • auaber of hours In half a working year . 



ERIC 



Fig\are 18 

Mathematical Depiction of the Discretionary Portion of 
' the WIN Allocation Formula fc^ FY's 1976 and 1977 




Factors 



»■■ ' . ' ' ■ •■ ■ » 

(1) nvarsM nonthly wtlfars grant reductions U^SSm) 

(2) ^/ n««l>at. of Job anttiaa ' v' * « 

(3) 4v««ii« ji»b Hhtry vage rate . 

(4) average retention rate on jobs 
/f (5) annual ddllar cosi . " . # 

(6) penalty rattf, fpr poor rep.ortlng 

Paraisetric | (7) "potential" WIN registrants . . / ' 
Factors I (8) average montlily wf l£are grant ^ . ' 

■ ■ ■, • • ■ . •>*■ ■ * 

These formula factors are combined in different ways to form six dis 
tlnct components within the discretionary formula* Together the components 
determine the suggested discretionary al^Qcatlon for each state WIN program 
These components arej: ^ ; . ° ■ 

(1) a welfare grant "'reduction (WCR) perfoftnancjp component; 

(2) a wages performance component; ' \ 

(3) a WGR potential component; ' ^* . ' 

(4) a wag^es potential component:; . . ' . 

(5) a WGR achievement of potential component; and 

(6) a wages achievement of potential component. 

As previously stated, each component uses a number of formUla fac- 
toro. For example, the "welfare grant reduction (WGR). performance com-? 
ponent" consists of four performance factors, as shown below. 

' ■ ' 

■f 

AMWGR (.12.12.Ai.Di.Hi)2/G, I /zo p.ercent of the total 

Performance - "* ^ \ i^. . 



Component 



012»12.Ai.Di»Hi)2/G^ j Aq percent of the total 'X 

J f—- — : = — ^ 1 . I Discretionary Dollar J 

i*j^j(U..12.Ai«Di»%)2/Gil I VAllocations for all states/ 

Where for each state WIH program: , • 

A - average monthly welfare grant reductions 
D • average retention rate on jobs 
G - annual dollar cost 
H « penalty rate for poor reporting 

( 

Also no factor is restricted to Just one component; each factor 
is used in at lea8|: two components. For example, the parametric factor, 
"potential number of WIN registrants," is utilized in four of the six 
components. This factor acts as a measure of potential performance against 
which' actual performance can be compared. 
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'Complicating natters even nore» coabinations of Rotors' are squared 
and dubed and are used in both £he nuneratoc and , denottinator of a number 
of coBponantit*, Thci rttiiU it il eonpl^ •yatiti intif-rilitidnihipi iti > 

which a chai)ge in one .'factor can have repercuisions in many of the for- 
mula's components. Table 42 lists the eight formula factors and indicates 
in which components they^are used» This complexity may well defeat the. 
formula's purpose of communicating clear goals and priorities to regional 
pxid state coordinators. ^ . • • . . 

to find but whist the priorities in the formula actually were, cor- 
'relatlon analysis and simulations were performed to determine the relative 
impact of individual .'formula factors on the discretionary allocations to 
' states . . ' , 

' . ' * . . ■ . . . . ' * . 

-Correlation Analysis . A bi-varlate 'correlation Identifies the degree to 
which change in one variable, such as^ a WIN performance factor, is asso- 
ciated with change in another variable, such as state discretionary alio- ' 
cations* It provides a stfatistic, the^orrelation coefficient, which 
d^escrlbes the strength and direction this relationship. The square 
of the correlation coefficient (the coefficient of determination) indi- 
cates what 'proportion of the variation found in the values of a variable 
is associated 'with those of another variable. . 

, • » » •' • 

* ^ t 

Correlation analysis (along with examioatioh of bi-variate scatter 
diagrams) indicates the degree, to which a relationship between two vari- 
ables la linear* However, as Figure 18 shorn, the discretionary formula 
.is not linear* Thus the relatlondhlp it defines betfween performance f ac- . , 
to4rs and discretionary allocations should also be non-linear. However, 
we suspected that another 'factor hot explicitly lncluded$;,ln the formula— 
the .relative size of stdte WIN programs— was actually the dominant Influ- 
ence on discretionary allpcatlohs and .that the relationship bet|^en this 
factor and the allocations was linear. Therefore, we felt that somethl'ng 
Important c6uld be learned from correlations '"between the formula factors ' 
,and allocations. ' - ^ 

« v ... 

Table 43 presents statistics on'' the 'Associations between formula 
Indicators and^ discretionary allocations I in FY 1977. This tab^le shows 
that a .state's share of the discretionary WIN funds can be accurately pre^^ 
dieted at a very high level of confidence from data on its welfare grant 
reductionsc (AMWGR) , Job entries or potential WIN registrants. However, 
'these variables are less performance measures than^they are proxies for 
size. As the size of a state's WIN program (number of registrants) in- 
creases, so do the absolute values of these performance measures. 
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T«4)le 42 

Eight Factors Used In Discretionary Portion of th/wiN 
Allocation Formula for FY's' 1976, 1977 and 1978 



Factors 



Components Wiere Factors Uaed 



Performance Component * Potential Component Achievement of Potential 
— — — — — ^-^—^.-L-.— — - ^ Component | 



!• Average monthly welfare' ' X 
grant' redaption' 

Number of Job entries 

1. Average job entry^wage rate 

4. Retention rate on Jobs X 

5. "Po£ential". WIN registrants* 

6. Average monthly grant 

7. Annual dollar cost of X-° 
state WIN program 

8* Penalty. rate for poor X 
reporting 



Wages 



X 
X 
X 



WGR 



Wages WGR 

Si 



X 
X 



X 



X 

X 
X 



Wages 



X 
X 

x„ 
x> 

X 



*I)etermined'by the number of AFDC families in a state multiplied by the 
national proportion of AFDC recipients who are registered for WIN, 



'l i. -^ '% j • • • . ■. '.-.1.^^-: 



•• . ■ • ■, , Tablets ■ • 

Bi-Variate Corr<^l8t ions Between itate Shards of blscreiiotiary 
Funds and Faccptfs In the FY 1977 WIN Allocation Formula. ^ 



Factors in Formula 

» , .r ■ 

• . ■' ♦ 

•AMWGR 

' ■ ' ■ 

Job Entries 1 

Mo. of Potential Registrants 

Annual Dollar Cost of State WIN 
Prograv 

Job Entdy Wage Rate 

AMWG • ' * 

Retention Rate 



Correlation. * Standard Error 
Coefficient- of Estimate** 



Pei^cent ' 
Variation 
EyplainSd 



*4 



\ 



^^-J^' *Statistically significant at the ..01 lev^l. ' ^ \ 
**The Standard error of the estimate is a stat'iii tic that describes the \ 
accuracy of the values predicted by the regression equation. The lower the 
standard error of the estimate, the more accurate th^ predictive power of the' 
regression equation. » . . * ■ / 



a « 

.965* 


' ' . .672 


93.2% 




— .~ oeo* 
.900* 


1.117 


Qb ML 

8x.i% '^'^ ; 




.597 


V, . 2.060 

» 


35.7% 




< 

.447 s* 


.. ' 2*296 


20.0% 


.'■ * 


.431 


.2.317 • . 


.18.6% 

♦ * ■ 


? 

• \i 


-;250 


2.486 







m 



Thus, the association between certain)per/ormance indicators and ' " 
discretionary allocations shown in Tab le?^ 43 4b mostly due to the influence 
of program scale. When the scale effect, is eliminffted, the correlation 
between the measures and discretionary allocations decreases dramatically..* .< 
As^Table 44 shows, state population Variation ^accounts for between "60 
and 75 percent ,af ^he variation in discretionary allocations amoiig states ' 



*The correlation of AKWGR with' al^loc^atlons (Table produces* a 
correlation coefficient of ,965. When each' state's AMWGR ia'iivided 'by 
that state's average monthlj^ cost of welfare grants, the correlation co- 
efficient drops to -.087. Similarly, the '.correlation of job ei^tries with 
allocatiotis is -.959, but the correlat1x>ns of Job entries 'per staff year 
with allocations is bnly ,164. • \, f 
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2,9.G 

/ 

/ 



« Table 44 



Bi-Variate Correlations Between State Shares of Discrejtionary Fiindp • 
^and Measures of WIN Program Scale for FY's. 1976, 1977, and 1978* ' 



FY 1976 



FY 1977 



( 



FY 1978 



Independent 
Variable 


Correlation 
Coefficient 


Percent 
Variation 
Explained ,\ ^ 


Correlation 
Coefficient 


^ Percent 
» Variation. ° 
' Explained 


Cprre,)Lation 
Cjsefiicient 


State -pOpula- 
tioti j. ' 




71.93% 


•.8712 

• 


75.90%' 


..77A0- . 


Average number 
of reglstranis 
in January 

» 


.9095 


82.72% 

» • c 

/' 


.9280 


86.12% — 


- ' .sa'so i 

1 



Percent 
Vai^iatioh 
Explained 

s 

71.A0% , 



Mil. correlation, coefficients a^e statistically significant at the .01 level, 



■ - ^ . • «■ ■ ■ » 

**The decitease in th:: influence of scale on discretionary allocations i^n FY 1978 is, probably d\xe 

to the change in thct definition of "rete^ntion rate" for .that year's WIN AllQcatioo Formula. 



.Y'. v:^^^ .y...-^ . . .. . ■ -.w. •• . .,. .■ . •.fl-. ^^^1,. . /■ V\. . ,^.\^■ . . i.v »•■,•:•,•*•• •¥^.' '••v. •■ ^ • \: • . !S-vt: .^^;^K..r,.^4;:.H;,^ 

y V for ry'i 1976 nhtbugh 197d. ^ -'Thir^eita^* liuibSr of rl|iitran5« (th« \ ^"-^ -r^S 

|y. major determlnaat of the dlattibutiion; Of discretions . .. 

4'-' '^the 8^iat««» .jHtH>ro^gram perfomaoc^ affecti'^^^ 'V.' 

' 'y\ : . - . " ■ ^1 " ' ..... .'.v.''. ' ' '*. \ ' •'■ r'i 

J: \ * '^is finding; had Isiplicatlbha for-thft kind of ^effbnaaaca taeaaureB' ' /'^ 
that %re'' t)sed In our' study' of the VW' progr^a tb''aa86ee>'i)rogr«jtt' effective*/ / 

vneaa and to detarnine the influence of eKogenoua factora on program out- ' ^ , I J 

puta« We felt that the^^erfonuanca measures wf^ used should control for ' - 'Pi 

scale. *Ihey should focus i hot on the ahsdlute level of .job entries, .AMWGR's , " / ^ 

and job entry wages, but o.n placement hraU'uct ivitv per staff . welfare' sav- \ .i >> 

in^s as a proportion of welfare grant c&sts and job, entry 'VaRes relative ^ ' (4' 

to 'prevailing wages ^ In , this way^ we were able to focus on the propuc- . '■ Mfi 

tivity or efficlep'^y of state WIN programs* yse of these kinds , of ^ perform* . 4 

•anc^ indicators « Id petmit cbiiparison^ 6f organisational {Characteristics ' i 

:<n highly' produ' e and eff indent programs VLth-^hose in less productive^ ' 
programs* h ' 



Given 

,analyB.^ls coul 



6. 



the ^non-linearity of the discretionary f ormula, 4|orrelatlon 
I do little aote than point up the!^ dominant rol|&* ecale played * ; -'^ 

^in distributing discretionary^ *WT.N dollars among regions^ and states'* It,/' 
could hot show which fprmuii a 'factors ^len considered .simultaneously ht^d ' . 

the greatest /Impact on ^ a Vi.^ate' 8 share' of these resource&*'. To Jind this 
^out. we next analysed' tb«i- effects on discretionary. allocations caused 
by a change in each fd'otoz;. independently and within, the context of tha 



/ 



formal a « 

Formula SlmulatlWs » One way to Identify the relative ^Importance o| fac* 
toirs la the alloc^at ion formula id to per^rm a computer simulation of' - \ 
the discretlon^r^/formuXay changing each'^f actor individually by a fixed 
/ percentage and evaluating the impact' of jbhat factoc on each, staters' alio- 
' cat ion « ' The most \important factors ^wpuld those whosts change on average 
^/ c^;^8ed the largest\phanges in state allo/cations** ^ 

' ■' » \ • * ' ' , 

• A .•••!■ 
\ ■ ■ • \ * ■ 

\ • '■ . .1 • * • .■ ■ • ■ ' 



A 0 I 



; *We are indebted to Dr > Charles H* Holt of the University of Texas > 
formerly with The Urban Institute^ for recommendations on methods for/ 
^ identifying, the telatit^e impact^s^of factors in the wIn ^location Formula 
on state discretionary allocations # 



v 
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r'i.i vff pi 



^St^^w^^ '^'t^ that p4^ffetlAhc# inaiettori in tha fonlIkt\that 
^^!?r«J!;ii^l pUe««i^nt* hi»v« » gwattt; Impact on 4iaa««ttonVty. 

: hlgh^ajij iipact on allocation* la cauaad by a liluitar'^ 

^h. wf^* '^"'TIV ****r i""^ *nWy.wag« rate haa ^ 

iSSuSrJi IL^J^^^'S!* !tono«»,4 by tfte nunbar of job enttlaa ind the " 
! iMnount of ^GR a. .Ilie raoalning four faetOra hava conaiderWly lei4^ 



I 
t 



Howjjver,, Table 4S praaenta only tho ayerafte effepta of qhangea 
in foToula fajtora on allocatlona for aU nute WIN piogratta. ,Thi8 pat:- 
A *f^**^^* l«pac?;a on alUcati^na <il<l not neceaaarily hold for v 
individual reglor^a and atat^a. Refeenti^on rata luid the most 'Effect on • 
discretionary. aUoeatl>>ns for 37 alate programa, but Job entry, wage Vatea 
had the greatest liif luenc^ in U atatea and job entrlea.Hn one ata^e. ; 



I 



*The following procedv^es were used in this, simulant ion: « 

i-*The accuracy o^^th^ diacretionary allocation formula aa pre- 
in .Figure 18 was flr^t tested by using it to calouUte alloca- 
p t?v*^?n?i*'f? tVje. pecforaance datte used by th€5 National office 

^or FY 1977 allocations and comparing the results to the actuaL WIN al- ' 
locations* - . ' , ^ 

--Each performance factor waa increaaed by 10 percent for each 
? ^''^ all other factors and all other atat constant at their 
FY 1977 levels. For excople, the AMWGR for Connecticut was increased 
i>y ia,pevcent whllb •the remaining aeven performance factora 'were held ' 
constant. By also holding all other atates constant at their FY 1977 
levela, thelmp&ct on each state's allocation is not confounded by the 
effects &i changing a factor in the remaining 51 WIN programs. After the 
calculation for CpnWticiit was comp^ened. its AMWGR value Was returned ' 
to ita FY 1977 value befor^ the next state's AMWGR value waa increaaed ^ 
and its impact on allocatlotia caiculai-ed. This proceaa6'as repeated^ 
,tor each state WIN program atid for each v^rf ormance factor. 
■ —By maintaining a constant tota.l\diacretionary Allocation for • 

the national prograip, changes ^n.the dollar amount of atate alloeatlona 
were equal to changes in state' ^area of the national allocation. • 

r- After increasing each j(:actor independently by 10 percent for 
each agency, the average impact op fetate' discretionary allocations due 
to thead Inceaaea was determined for each of the eight pfetformance fac- * 



tosfs 



in the WIN Allocation /Formula. 
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Ta^le 45. 



Average Changes Irt Discretionary Allocatlona Caused by a 10 Percent 
Increase in Each of Eight Formula Factors, with all 
Other Factors rield Constant at FY 1977 Uvels. 



Alloc«eion formula 
Factor 



Retention, Rate 



V 



* 



Average Change in State^ Aange of Changes in ^tate 
.Discretionary Allocations. Discretionary Allocations 
— ^ Caused, by a 10% . Caused by a 10% 

in^reaae in che Factor Increase in the Factor 



WageFRate 

/ ■ ' 

Hunger of Job Entries 

Penalty for Poor Reporting 
Dollar Cost 

Potential WIN Registrants 
Average Monthly Uelfale Grant 



14.97% 
8.3U 
7.53% 
7.47% 
-6.44% 
-5,44% 
*2.2(^% 
1.11% 



2% to 27% 
4% to 17% 
2% to 20% 
0% to 17% 
-15% to 0% 
-9% to -1% 

> 

-5% to 9% 
-3% to 4% 
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In no staU vaa AMWGR the most 8tgnlf leant factor, but in some It ranked 
hlgber than its fourth place In the national averages.* 

I* 

m 

«. factors' ImpActs can be very different in different states. 

Th*^ effect on dlscretlon*iry allocations of 10 percent increases in the 
four leading performance factors is 8ho%m for four selected states In 
Table 46 . This, wide variation means that, given the current allocation 
formula, a particular state program, might or might not maximize its share 
of discretionary funds by emphasizing those performance factors which 
have the greatest average Impact on allocations nationally, 'in the ex- 
ample below, states A and D would, like most states,, gain most by im- 
proving their Job retention rates. However, state B would do better if 
it emphasized Job entry wages, and state C would gain a bigger* payoff ^ 
from improving' job entries than from either retention rates or job entry 

Table 46 . 
Percentage Change in Discretionary Allocation Caused by a 10 Percent 
Lncreas* in Leading Performance Factors for Selected State WIN Programs 

Amount of^ 
AMWGR 



State WIN 
Program 


Retention 
Rate 


Job Entry 
Waees 


No. of 
Job Entries 


State A 


• "27% 


13% 


17% 


State B 


- 6X 


10% 


6% 


State C 


10% 


• 10% 


' 12% 


State 0 


23% 


'. 5% 


6% 



10% 

1% 

10% 
17% 



Furthermore, the simulation shows only how changes in the perform- 
ance factors affect discretionary allocations, not whether changes in the 
'factors are practicable for states. Retention rates may^ have the greatest 
average- influence on allocations, but the many states which already have 
retention rates ,in the 90 percent range would probably not .be able to 
Improve them significantly. They would achieve more payoff by seeking 
to improve performance on other indicators. 

I 

More generally^ the ranking of the indicators considers only the 
potential, benefit J^/illocations of increasing each Indicatpr, not the 
costs of doing soC/To improve retention or wage rates may potentially 



*See Mitchell et al . (1977a), pp. 17-20. 
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yield a state the greatest return, but If the staff resources or other 
costs required to do this are'hlgh» Improving performance on another in^ 
dicator may be more cost-effective* 

For several reasons* this simulation oversimplifies reality. It 
identifies the potential impact of formula factors on discretionary allo- 
cations* It holds all other factors and states constant as one factor 
for a state is increased* This isolates the influence of each individual 
factor on individual states. ' • 

In. reality* the influence of individual factors^ is not Isolated* 
Tie Impact of each measure on a given state's allocation affects the im- 
pact df the other measures* Each state's performance on the measures af- 
Ffects the relative performance of the other states. And* as explained in 
Section 3* performance on the various indicators Is strongly influenced 
by a number of non-program factors such as labor market conditions and 
the demographic characteristics of WIN registrants. These effects, too, 
vary from indicator to 'indicator and from state to state* 

Our analysis of the WIN Allocation Formula showed that: 

(1) Essentially the same formula was used in FY's 1976, 
1977) and 1978 to allocate discretionary funds 

to « regions and to suggest allocations to states* 

(2) State discretionary allocations were determined 
more by the comparative size of state WIN programs 

' than fey their comparative performance. 

(3) While eight formula factors played a role in cal- 
culating each state's suggested funding level, 
four of these factors had by far the greatest 
impact on discretionary allocations. In order 

of impact, these, four factors are; * - 

--Job retention .rate 
— Job entry wage rate 
—Number of job entries 

— Average monthly welfare grant reductions (AMWGR) 

(A) The discretionary portion of the allocation 

formula Is so complicated that determining which 
performance measures have the greatest infl.u-- 
ence on allocations would be very difficult 
without simulations of the kind reported here. 
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. Policy St atements on WIN Perfornance MeaButfta 

Because the WIN Allocation Tortiqla was difficult to Interpret, 
it was probable that many WIN coordinators assigned priorities to pro- - 
gram goals and to performance indicators based primarily on the oral and 
written -messages sent out by the National Office* 

* 

This section examines the performance measures that were empha- 
sized by program documentation and that WIN officials said were Important. 
^It compares those statements to the budget messages found in the, formula. 
Questions addressed Includje the following: ' . 

>e Are WIN administrators at different leVels aware of 

the performance indicators and relative priorities ' 
emphasized In the WIN Allocation Formula? , 

• Do. they see these indicators and priorities as the > 
most appropriate for WIN? Do they think other ob- 
,Jectlves are more important? 

• ♦ 

e Are the indicators and priorities stressed In the ' 
WIN Allocation Formula also stre^^d in directives 
the National Office sends to the ^^d? 

These issutes were addresse.d through a review of WIN program docu- 
ments, lntejC3*^ews with National Office* WIN staff, tlnd i survey of state 
WIN coordinators* ~ - 

Program Documenta tion on Goals and Objectives , A review of WIN documents* 
showed that National Office policy statements had consistently stressed 

- f 

*We reviewed the following program documents for>ollcy statements 
on the WIN program and for indicators to" measure regional and state com- 
pliance with these national policies: 

(1) National Coordinating Committee Operating Memoranda (NGCOH) ; 

(2) Explanatory material accompanying WIN Allocation Formula 
cromputatlqnal tables and suggested allocations; 

(3) WIN Operational Planning and Review System (6PR£»); 

(4) WIN Handbooks on regulations,' procedure^, and processes; 

(5) WIN Financial Management Handbook and guidance on reporting 
systems; 

,(6) WIN and ETA guidelines on regional monitoring and review of 
state programs; ; 

(7) Preliminary reports from the management indicators project; 
and 

(8) Internal program memos on performance .indicators* 



I 
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th« ta^e multiple objectives during the period 1975 to 1977.*^ State * 
programs were instructed to as8l8.t WIN registrants to find employment- • 
leading to aelf-auff Iclency and independence* The quality oNJLobs, me.%8- 
ured by entry wage rates and retention rates, was. ta be< such that reg- 
glstrants would eventually leave welfare rolls or at least significantly 
decrease their dependence On welfare. The four objectives— Job entries,, 
welfiare grant reductions^ and quality of jobs measured by entry, wage rates 
and retention 'rates— ^ere to be^ attained in the moat cost-effective manner* 

However, the .emphasis the National pfflce gave to each changed 
during the period. For FY 1976 and FY 1977, direct placement— the quantity 
of job entries— appeared to be given top priority. Maximizing the number . 
of job entries was emphasized as the most cost-effectivfe way of reducing 
welfare grant .coasts. The quality of jobs in which registrants were placed 
was apparentjly given a lower relative priority.** States and regions that 

*We chose the three year time frame, 1975 to 1977 because It is 
the most recent* Thus, it is most relevant to the program as it now ex- 
ists. Also, it la a period of rel|itlvely stable poll'cy in WIN and one in 
which the allocation formula remained unchanged. Prior to 1975, inajor 
Emphasis had first b^en placed on training and supportive servlcjes (1968 - 
1971) and then on thf single objective of direct placement (1971 - 1974).. 

**NCC Operating Memos transmitting suggested airocatlona for FY's 
1976 eftid 1977 tended to emphasize increasing the number of registrants 
being placed. For example, the memo for the FY 1977 allocations gave a 
full array of objective^, but direct placement and placement-related ac- 
tivities were listed before objectives on improved retention and wage rates 
In. the memo's "national objectives," "policy emphases" and "operational 
emphases" sections (NCCOM No . 20-76, June 1, 1976, ppi 1-2). In addition 
the Handbook for the FY 1977 WIN Ailocation Formula contained the fallowing 
references: * ' * 

"The number of registrants who get jobs is one of the most im- 
portant factors in determining how much money a state gets. Thus 
It is Important to understand the trade-off results in terms of 
WIN dollars received from the allocation formula. Such a trade-off 
could be between emphasis on' making more placements and emphasis 
on making fewer placements, but in Jobs with higher wage rates 
or in Jobs ih which registrants are likely to stay for longer 
periods." (p. 3) 

.. "* . . the number of Jobs is much more Important than the wage 
rate for allocation." (p. 15) 

"• . . if a program manager finds that providing an orientation 
session or 'training option results In doubling the wage rate for 
many clients" or Increases the retention rate substantially, he 
can afford fewer placements.*' (p. '17, emphasis aided)/ « 
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followed the verbal directives of the National Office would have enipha- 
'^eised nunber of job 'entries* In fact, as we have seen,, changing place- 
nent' parformance was far^ less likleily to affect a state's discretionary 

.allocation under the WIN Allocation Fortinula than changing retention 
rates* 

^The language used in policy statements for FY 1978 seems to show 
a shift** Job quality was given a policy stature at least equal to number , 
of Job entlrles* This brought written policy statements in line with the 
fiscal message on priorities* found In the WIN Allocation Formula* Now,' 
if states and regions followed National Office policy directives, they 
would atveaa retention and wag^ rates— the factors that do, in fact, yield 
the largest rewards under the dl'scretionary formula* 

While this change Is partly obscured by general and varying* 
phraseology In some, statements about program goals and e,bjectlyes, it is 
still discernible V Furthermore, the change was verified b> our Interviews 
with National Office administrators who told us that they were moving to 
an emphasis on job quality rather thari quantity of placements, while still 
maintaining a ballanced mission o£ multiple objectives* . 

Anothi^ source of guidance -are the measures used within' the pro- 
gram itsel'f to monitor aiM 'assess achievement* Program documents mention 
dozens of such indicators*** Some measure actual levels of activity agtiinst 

*For example, the NCCOM tl^at accompanied FY 1978 suggested alloca- 
tions stated: 

"Since retention rates have a tWo-:|old impact on the allocation 
formula, it is in the best interest:' of each state and RCC to focus 
on improving this activity*", (NCCOM Ho* 20-77, May 31, 1977, 

■ 'p- 3*) . ' 

**The program documents reviewecl and the number of indicators 
suggested by each are as follows: 

Source '± No* of Indicatoxs 

WIN Financial Management Indicators, WIN 
' Financial Management Seminar Handbook 
WIN Program Management Indicators, IMPACT'S 
"Summary Descriptions of Management 'Indl<^ 
catbrs" 

-WIN FY '77 PerformanciB Indicators, WIN Opera- 
tional Planning and Review System (OPRS) 
, "Three Level Monitoring Concept ."'' Data Users 
Guide (Preliminary draft) * 

.'f 

Internal WIN memo recommending the use of ten 

measures as key "analytical indicators" 
Regional Review Process Guide 
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16 
25 



13 

5 (level I) 
12 (level II) 
51 (level III) 

10 
96 



planned levels t Some focus on the productivity of WIN service staff (or 
SAU staff ) f and others are concerned with fiscal accountability and cost** 
ef f«ctiveness# Several performance indicators lire used to measure es«* 
sentlally the same phenomenon'** 

Despite the bewildering variety » the phenomena being measureii re« 
main substantially the aame^-the quantity and quality of Job entries*^ wel«» 
fare savings, program and service component costs,* mix of services provided, 
and tt>e demographic characteristics and status of regiatrants. Han5^ of the 
performance indicators used in the WIN program measure in one way or another 
the foO^r performance factors emphasized in the WIN Allocation Formula— *Jpb 
retention rate, entry wage rate, number of Job entries and welfare grant 
reductions.** • • . - . 

1 > \ . • 

National! Office Perceptions on Goals and Performance Priorities . Exls^t ing 
performance li\dicator8 and documentation about ^themNflre necessary--but 
not suf f'lcienc^evidence of what prQgram goals and priorities National ^ 
Office staff consider important. TherejEore; we also posed the^ question 
of goals to the National Office directly in the course is^f intensive in- 
terviews with some 20 officials there.* \ 

National Office staff appeared to* agree substantially about goals. 
Air said that WIN^s mdin objective was to help AFDC recipients become se^lf-^ 
sufficient and/or decrease or eliminate their dependence on welfare. Most 
staff thought th^t the best way to achieve this overall goal was a program 
that balanced the specific goals of Job quantity, Job qtiality, and reduc- 
tions in welfare grants* Within/this group, the majority gave greater 
weight to the quality of Jobs; the minority, to quantity of Jobs. *^None, 
however , -wanted to pursue either quantity or quality to the complete ex- * 
elusion pf the other. The dlffei;ences were matters of degree only, not 
cleaf^c^fr disagreements. 



' *For example, Job placements may be presented as total entered 
employment, full*«tlme entered emplo^ent, direct Job entries, volunteers 
entered employment, entered employment from labor market exposure, etc. 
Similarly, placement data can be treated as a benefit-cost .ratio (cost per 
' entered -employment) , a productivity measure (nujnber of Job entries per . 
staff year), a measure of goal .achievement (actual vs. planned placement) 
or a penetration rate (proportion of registrants that are placed). ' . 

***These four factors play a role 'in seven of the 13 OPRS perform- 
ance Indicatdrei, 32 of the 68 iWlcators used in the ''three level WIN 
monitoring system^' and 20 of thk 25 management indicators developed by 
IMPACT (Institute for Manpower Program Analysis, Consultation and Train- 
ing, Inc.). 
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National Office staff were also asked which indicators they u8e4 " 
to asse'ss regional and sti^te performance. Here, the Consensus was not 
as foeused but w4s still clear. Of those* staff who followed regional and 
state performance data (many watched only national trends), the largest 
group looked at the same four indicators which we have found most signifi- 
cant in the WIN Allocation Formula— Jolj Entries, retention rates^ entry 
wage rates, and AMWGR. They felt th^*' these indicators in combination 
(along with program cost .data) provided the best overview of a region's* 
• or state's performance. Some also reviewed actual against planned activity 
levels ^nd expenditure r^tes. A smaller group looked only at placement 
indicators or gave them priority over other indicators. Overall, once 
again, the differences among staff seemed to be more of degree than of 
kind • y ■ ^ 

The statistical and simulation analyses of the WIN Allocation 
Formula reported here were discussed with senior National Office staff 
during two meetings in July 1977. Tlie consensus at both meetings was- . » V 
that the relative impacts of formula factors on allocations reflected 
National Office i>riorltlea. There was also agreement on the type of oer- * 
-formance measures, that we would be using in our study qf the WIN program. 
I.e., measures which reflected- productivity and efficiency, tather than 
the 'relative size of -state WIN programs. 

Three' approaches "were deviated for Tdeflhlng" WIN performance and 
^were presented during our second meeting with National Office staff. The . ' 
flrbt option simply Involved the selection of .-one of the four measures ^ 
as the key performance measure for assessing state WIN programs. This 
option was quitkly discarded. The 'second option gave equal importance 
to each ot the four measures. The third drew;upon our findings from the 
analysis of the allocation formula. It gave each measure a policy weight 
equal to its relate. ve impact on discretionary allocations. The consensus 
of the group was to use the third option. ' * 

To sum up, the degree of goal cons^ensus among National Office staff 
seems. high. , This consensus a^so agrees closely with the objectives em- 
phasized in the> WIN. Allocation Formula. However, National Office prior- ^ . 
ItlQS have come to agree with the balanced emphasis in the formula only 
recently— earlier, a stress on direct placement wfs evident. 

Therefore, It cannot be asstuaed. that sta^Te WIN coordinators hear 
clearly the message coming from the WIN Allocation Formula and the National 
Office, or that they agree with It. We tu^n/tiow. to some evidence that was 
actjulred -prior to our field work in ten" aata/le states about state-level 
perceptions of WIN program goals and prloFlties. 

' ■■ ■ ■ / ■ ' • ... 

I 



State WIN- Coordinator Perceptions of Program Goals and Prior it les » In a 
survey of stace WIN coordinators, we included two^questions on the relative 
impprtance of WIN perforoanc* indicator^.' The 4uestiotis and the results 
are given in Table 47. ^ * 

... ■ ' •* . ' ■ " ■ 

One question concerned the performance measures that state WlH " 
coordinators used to assess .their local service delivery, units and also 
asked for a ranking by t^mportance of these measures. The other question 
sought what they perceiVed to be the performance measures used by* fjederal 
program managers in assessing state programs and what federal officials' ' 
relative priority was* 'v ... 

Generally, stjate WIN coordinators ranked performance goals in, the 
same order as they felt federal WI$I managers ranked them. They gave top 
priority to the niiqiber of placements made, followed by welfare savings and. 
Job retention jrate^. This is probably donsistent with policy statements 
on priorities given by the National Office prior to the release of FY 1978 
planning and allbcat ion materials. * ' ' 

* • • . 

HoHever* as lahle 48 shows, important differences exist between 
what state WIN coordinators .saw as performance priorities and what factors 
are most heavily rewarded iti the WIN Allocation Formula.. ♦ 

Standardized Performance- Measures . " 

Four measures were identified as the key indicators of WIN program 
performance through our analysis of, the , WIN Allocation Formula, Interviews 
with National Office 8ta|f, a review of program documents and a survey of 
state WIN coordinators. ' ' . 

^ These findings were Important to our institutional' analysis of the. 

WIN program* The indicators made possible an agreed definition of per-- 
formance by which compare state WIN programs* These measures were used 
to identify the organizational and^ managerial features of state and local 
programs which seemed conducive to high and low performance. As mentioned 
above, National Office staff 'supported a composite performance^;kidlcator 
for state pifograms based on "our findings. ' 
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. ' tabled...- : T" . _ . ■■ . . • V>. 

Comparison c^ VPr toy ity lUnkiiig A' of P^^^ '/ ^ i * : 

♦ by Dollar' Payo'ff^ tn WIN Allocation' Formula and 
byHtate WIN. Coordlnatore 



Performance ' , • 

Indicators IGoala)- 

Job Retention Rat:& 

Entry Wage Rate * >. . 

Number o^ Job Entries 

Average Monthly Welfare Grant* 
Reductions (AMWGR)^' 

Dollar Cost of State ^rog,raia, .' 



Ranking by 
' Doll^ar ?ayoft 
In WIK Allocation 
Formula 



3 
4 



' Ranking by 
Perceived Priority 
of State WIN 
Coordinators 

. ■ ^ * 

3 . • . ' 
* • . • 

. .1. ' • 



I 



I 4 



Two operations were iiecessary to deivelop a ^composite measure. 
First, the iridlcators used had tb be standardized to ^eliminate/ the "scale 
effect" In the allocation formula fact6rs as they existed. State programs 
with large numbers of registrants would necessarily Wa^e had large numbers 
j^of job entries and welfare' grant reductions compared' to, 8t«kt:eb with smaller 
registrant populations. Differences among states in prevailing wage levels 
and the amount of average welfare grants also had to be controlled for* 
.We standardized job entry wage by dividing each state's or local opera- 
,tion'8 figure 'by its prevailing average wage jrate.* Similarly, the numbet. 
of job entries for each state or local program Was divided ^y its number , 
of paid staff positions, and the, average' monthly welfare grant reduction 
(AMWGR) -of each state or 'local operation was divide<l by its average monthly 
welfare grant costs (average welfare grant., malt Iplled by number of regis- 
trants) . Retention rates required no standardization. ' 



Table 47 



State WID Coordinators R^sikiiig ;o£ Pi^ogrtun Perfomance Measures 



» 



9^ As a state WIN coordinator, what' oaaaureCa) o£ WZK 
« parforaanoe do you use to avsluata ,^oeal unit 
' 'perfopnanee? Please rank the folldWlng performance 
oeasures frbm 1 (mo^;t Important) to 6 (least • 
iaportantj. . ' " ^ . 



Average ranking .' Average rank 
scores by' 52 state order by 52 state 
coordinators coordinators 



;number of job entries ^ ; 1.10 

welfare savings 2. 70 

Job retention rates 2.74 

s cost effectiveness 4.26 

.mi 

wage at Job entry 4.62 

* 

number of AFDC employables served 5.06 



(1) 
(2) 
(3) 
(4) 
(5) 
<6) 



"1? 



Q: What do ycu see to be the ImpCrtant perfonsance 
measures by which Federal administrators 
currently assess* your state WIN program? 
Please rank the following in order of 
lfflportai\ce. . « . . 



f 

t 


Average ranking 
Scores by 52 state 
coordinators 


Average rank 
order by 52 state 
coordinators 


* 

number of Job entries 


1.24 


(1) 


Job retention rates 


.3.00 




welfare savings 


• 3.16 . 


* 


COS t ^ef.f ec tlveness . 


4.27 


(4) 


wage at Job entry < 


4.43 


(5-) ^ . 


number of A?DC employables served 5.02 


\ ' (6) 
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5>Vi •;«,:- .■ ; . .*i :.. f •■ fJ!#j.£' ■.\»3-')m"w': -V ■ ■ ■■-■~r- ■^'^^'^V■'■'^T■^■"'' ■'^«' ^i^'- oSTtV v<i5./':'vH'i' V'-'W*^^ . ' •^"'f'■*>^••••'^#????4^^^ . 

•^«*ctiviJtti*i\pr^ptoduetiVity-:liit6^.th* -VV 
;1; • .analys Is showed the relative coist of itatis WIN |)rogi4ma to be •aPleta aig- . ^ 
l> ' nlf leant perforinance measure in the HIN i^: location 'formula *nd in National ^ * -q ^ 

f-' AMWGR. 'However,. this factor wa6 still vital to National Office fetaif with ^' 

3. . and'^ financial iMinageme|it reapc^ifiblllties/ Ad ^a ^> . 

V tlvlty, staff reaources also could be measured wittiout consideration'' of* 

.dlffei»ences In pubaic employee wages among et^ates-r-a factor beyond the.. ^ . 

control of WIN managers. . ■ ■ mk - 

^Second, the standardized factors had to be weighted to produce's ; , • 
. . composite measure. As our simulation analysis sh9^ed, the factors had i 
different relative impacts ;on state discretionary allocations. The dif- ' - * ' * 
fervit weights reflected the policy priorities. of National Office WIN • ' 
administrators. We have used these same relative .weights to produce the 
composite indicator. , • t . ^ ^. 

.1 ■ ■ • • . .... • ,. . 

'^^I'l® 49 presents the standardized performapce measures that we V * 
used in our institutional "analysis of the WIN program and the weights V 
used for each. The tiable also giVes the data sources "for each measure. *« 
, Some of these standardized measures are identical tq performance indi-. * ' ^ 

catora found in WIN program, documents and used by some WIN reposing or 
^ monitoring systems. ^ " , " - ; 

Two qualifications sh/uld be emphasized. First, the indicators 
. chosen were thpse stressed as njost important in the WIN Allocation For- 
mula and in National Office pr,onouncementlB and perceptions. They were 
not. policy judgments which we made. * » ' 

. Second; performance criteria other than the four indicators were 

not Ignored in the course of field research. For example; we attempted to 
• identify and examine data on SAtJ perfoAance, such as the number of regis- 
trants' certified per SAU staff and the availability of Supportive serviis^es. 
Prqblems associated with 8uch> SAU measures of effectiveness were dealt with ^ 
. in detail in the main body of ' our report. . •- • ^ 

3. Sf/cio-econonAc Influences 'on' State ^ ^ . ' / 
- . ' J WIN Perf^mance Levels - _ 

V / . ■ '■ \ 

This section i>resents findings of our analysis of data on state 
, socio-economic environments and their relationships to state WIN' perform- 
ance .levels. It addre'flses and tests a basic hypothesis of this s^udy; 
namely, are some syate socio-economic settings more conducive to meeting * 



296 



V 



Table 49 

. •»•■ • .. ■" ■• ■./ ,>. 

Standardlaed WIN Pcrforwancft Me aaurea. Data Sources for Heasur^a and Weighta 
. Dcrlvgd from Analvaia of WIN mocatlon Formula , • " • ' 



Krfonaiitt 
Hf iuraa 



la • kattntUii itlita 
rr«villln| Uifi Rau 



3a Hupbar of Job Entrl^a 
Staff Yoaittona raid 



\ 



OaM lotircai ' 
lor MtAiurta 



WIN AUocaMoa FpnittU Tibia zM 

c 

m Alleeitlon Permili TabU 6.i//AvaKait 
Kpurl^ |tea«.ii'arnth|l of pcoduetlon 
. \^workara en nanufaeturlni payrolli 
(Enployaitnt an4 Barnlnia, IL8) 

, * 

f * 

\ WIN .Allocation Poriula Tabla S| Col. 7.2//£oat 
^ccoMntiHK Syataa U toof t. 96 . ^ 

\ 



\ 

Avtragj Hon thW WeUta Grant Kaductiona WIK^AUeeatloh Peraula Tabli 3, Col. 3.1//VXN 
Avtcaia Monthly Vtlfara Grant Coata AUetattoii.ronittla Tabla 6, Col. fi x Tabla. 1, 

■ \ Col. 3.1/ 



Watthta Dirtvad tin 

Analyi.ta dl Vtlt 
' Allocation Fowula 



Abaeluti 

U.9I ' 
6.31 



7.33 



7.47 



Ptteaat of' . 
3f,lU 

ai.7a ' V 



is.su 



1. Col.' 7 lot WUt Col. 11 for PT'77 and Col. 3 for n«78. ^ 

I. "Trua" volghtad avaraia uaini Cola. 3, 4i « and 7 for h'a '76 and '77$ TabU 4, Col. 4 for n«7«. 

3. .Tabla 4, 'Col. 3 for. ^'78. 

4.. Tfibta 3, Col. 2/Col. 1 for n'78. 

3. 'Tabla 7, Col* 3 a tabla 1, Col., 3 for n*78. 

I. Abaeluta vaifhta total to 3&.aBt '«e that 14ff7 la 38.11S of total.. 
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WIN perfonnance .objectives Chan others? And If this Is the case, what 
socio-economic indicators best describe. differences among state environ- 
ments? Which of these are most systetaatlcally associated with perform- 
ance differences among state WIN programs? . ■ ^ 



0 



'u4 u , f^^^^ ^'^^ programs In certain kinds of settings tend to attain 
. higher levbls of performance than programs In other types of environments, 
then th.e envlroAment in a very real sense defines thelr^ potential output. 
To varying degrees It hinders or facilitates the movement of WIN regis- 
trants Into eoi)l.oyment. It similarly influences the types of jobs avail- 
able, the hiring criteria of employers, likely wage rates and the duration 
Of Jobs. These^oreir as environments differ among states, so too do their 
potential performance levels. These environmental differences thus should 
be considered in some way in evaluating state pr|)^rams and identifying 
organUatlonal factors that might'differentiate the more "efffectlve" WIN 
programs from the less "effective" ones.. . . ' 

Comparing state WIN program structures, resource' management and 
processes Vlthout taking account of environmental differences would be 
similar to cpmparlng the harvest of a farmer on rich delta land to that 
of a farmer on rocky hill country. One would naturally expect differences 
in their production. But would the farmer on fertile land be any better 
d farmer—be more effectively operating his farm—than the one facing " 
leas favorable soil conditions? The same holds for state WIN programs. 
Officials and staff in state programs facing more difficult labor markets 
could be operating their programs more effectively than those in more fa- 
vorable env^lronments. But because of environmental differences the less 
effective operation could have higher absolute levels of performance than 
the more effectively operated program. Analysis presented in this section 
is meant to minimize the distortion of our perceptions of relative program 
performance caused by environmental differences so that we can examine or- 
ganizational characteristics for their possible associations with program 
performance. 

This section first addresses environmental factors that have been 
hypothesized to affect program performance and describes the data base we 
used to test the hypotheses'. Next we describe the statistical analyses 
done using these data to test which of the factors are individually and 
in combirstion most closely associated with WIN performance as defined 
In the previous section. Lastly we describe how we used these results, 
plus qualitative information, to identify a sample of high and low per- 
forming state programs for our field research. 
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" Developing tfv^othea^e and Data Baaes 



The flrat atep In our analyala vaa to identify economic or labor 
market con4itlon8 and dempgrap.hlc characterlatlca of WIN reglatrants that 
'might have a s^lgnlf leant effect on program performance and thus might be 
related to some' of the variation in performance among the states. Pre- 
vious researcH on WIN was reviewed to f livd which exogenous factors* h.ad 
been suggested in thpse studies as possibly affecting WIN activities 
ao4 performance* ' ^ 

Since the focus of most of those studies was the impact of .tb»^ 
WIN program on partlclpatits, they ylel.ded some suggestions about the^os-- 
sible. relationship between registrant demographics, WIN services provided » 
•and program perfotmarice. However , "^few were concerned with the effect of 
economic and^labor market conditions on program performance* Thus» we 
developed hypotheses' ourselves about how WIN performaniqe ,might be affected 
by conditions , such as unemployment rate, prevailing wage levels and union- 
ization/ Hypotheses were also developed about the likely impact of a few 
relatively fixed program characteristics for which reliable data could 
be obtained, such as- entry level salaries of Interviewers and counselors* 

* 

, The hypotheses "knd data sources presented in Table 50 identify 
the sofclo-economic indicators used in this analysis* Footnotes to this 
table indicate previous studies that suggested some of these hypotheses* 

For each factof the data ^used were aggregated at the state level* 
If comparable data. were not available for at least 49 states and the Dis«- 
trlct of Columbia, the factor was dropped from the analysis*' For example, 
'^new hire rates in manufacturing" was eliminated because it was available 
for only 38 states* Some other factors were dropped because we could find 
no data bases that J adequately described them* For example, we could not 
obtain data by state on '^average number of dependents in WIN registrant 
household," *'average amount of time since last full-time employment for 



^Exogenous ' factors are those environmental conditions or external 
constraints which program administrators canhot control* They are the 
"glvens" under which programs must operate* 
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Table 50 . " ' 

Soclo-Econonlc Factors Hypothesized to Affect Performance of WIN Prograos 



General Economic and Ubc. 
Market. Factors 

Labor force participation 
rates 

-Total 

-By sex 

"By race 



Rate of growth In non-agri- 
cultural employment 



Proportion of non-agricultural 
employment unionized 



Population density 
(population per square mile) 



Rationale or Hypothesis 



-High labor force participation 
indicates a strong demand for 
labor. In siich an area, WIN 
reglstrsnts are more likely to 
be placed into Jobs. 

-Participation ratcts reflect 
social norms in the comnunlty, 
the state, and the risgion. 

-Growth means an Increase in 
Jobs and demand for labor. 
Increased demsnd leads to a 
lowering of Job entry qualifi- 
cations, more OJT opportunities, 
and probably increased Job' 
entries for WIN. 

-A high degree of unionization 
means that many openings 
especially at higher wages-- 
are filled through union channels, 
not through the ES or WIN. 



-Greater density rowans a bigger pool 
of potential workers, a higher 
sklUed work force and thus fewer 
WIN placements into high wage Jobs. 



Source of Data 



Geographic Profile of 
Employment and 

Unemployment . BLS; 
Press Releases from 

. CLS 



Years data 

collected 



, 1976 
^975 
1974 



Employment' and Earn- 1976 
Ings. States and Areas . 1975 
1939-197A ; ^ 1974 

Employment and Earn- 1973 
Ings . monthly for 
1976 and 1977 



U.S. Statistical 

Abstract. 1976 . 

Table 619 t 
U.S. Statistical 

Abstract. 1975 . 

Table 606 

U.S. Statistical 

Abstract. 1976 . 

Table 10 
U.S. Statistical 

Abstract. 1975 . 

Table 11 
U.S. Statistical 

Abstract. 1974 . 

Table 11 



1974 
19^72 



1975 
1974 
1973 



31 



Table 50 " ^ , - 

* * 

Socld-EconoBic Factors Uypothetisad to Affect Performance of WIN Programs 

(continued) 



Proportion of state population In 
large metropolitan areas: 

(1) plsces over 250,000* . 

(2) places between 100,000 and 
250,000 population 



Prevailing wage dstai^ 

(1) Average hourly gross 
earnings of production. - 
workers on manufacturing 
payrolls 

(2) Average Weekly gross earn- 
ings of production workers 
on Rianufacturlng payrolls 

Unemployment rate 

(1) Total number of persokjs 
unemployed In a state, as 
a proportion of total 
number unemployed 
nationally 

(2) Official unemployment rate 
for each state 



Rationale or Hypothesis 

-The labor exchango function will be 
more dlfHcult for WIN In very large 
metro areas (over 2^0,000 popula- 
tion), wliere there will be many other 
labor market Intermediaries.. 

-The ES and WIN are probably more 
successfu.1 In penetrating the labor 
market in comnninltles with population 
between 100,000 and 250,000. 

-Areas with high average' earnings alao 
have a high degree of unionisation. 
The industrial make-up will be more 
skilled, and the Job exchange func- 
tion for Win will be more difficult. 
The job entries that are made will 
probably be at a low wage. 



-High unemployment rates reflect a 
decreased demand for labor and 
Increased competition for Job 
openings. Job entry qualifications 
will be higher, and placements for 
WIN will be more difficult. 



• Source of Data 

Current Population 
Reports . 
"Population 
Estimates," Series 
P-26« Numbers 75 



Years data 

collected 

1975 
1974 
1973 



Employment and Earnings . 

monthly for 1976 and 

1977;. 
BLS Handbook. 1975 



Employment and Training 
Report of the 
President. 1976 ; data 
from BliS press relase 



1976 
1975 
1974 * 



1976 
1975 
1974 



L, To Insure current and comparable data, average wage In manufacturing was used rather than average wage 
employment covered by unemployment compensation. The most current figures available for Ul-covered employment 
for CY 1974, while manufacturing wages were available for CY 1976, ^ ' . 
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Table 50 

Soclo-Economlc Factors Hypothesized to Affect Performance o£ WIN Programs 

(continued) 



o 
to 



Average employer alze 

(emp.loyer units reporting under 
. s,tate unemployment insurance 
programs) 



Proportion of non-Agricultural 

employment In low-wage 
Indus trieai./ 



Rationale or l^ypotheflia 

-States with small average employer 
sice probably have little unioniza- 
tion and fairly low prevailing wage. 
Thus more entry level positions may 
be available to WIN at wages close 
to average for the area. 



-the higher the proportion of employ- 
ment In low wage industries the more 
nearly competitive WIN registrants 
will be with the non-WIN.Job seekers 
WIN registrants will get only entry 
positions, or perhaps return to jobs 
similar to those held in the past, . 
rather than high paying Jobs. 

-757. of female welfare recipients who 
wbik and non-welfare poor are 
employed in personal services or 
wholesale and retail trade. Over 
5071 of males (welfare and non-welfare 
poor) are employed In low-wage non-durable 
goods manufacturing. (Miller aud 
Ferman, Welfare Careers and Low-Wage 
Emplovinent . 1972.) 



Source of Data 

Employment and Waynes. 
Quarterly 



Years data 

collected 

1974 
1973 



Employment and Earn- 
ings. States and 
Areas. I939-197A 



1974 
1973 
1972, 



2. This factor's possible relationship to WIN performance was. also suggested In Hausman, 1969j Miller and 
man, 1972; Friedman and Hausman, 1972; and Thompson and Miles, 1972. 
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. Table '50 v 

... ' k . . , 

* 

Socio-Econoalc Factors Hypothesized to Affect Performance' of WIN -Prograqis 

^contlhued) . . ' 



Proportion of population at or below 
povertyl' " , 

<1)' Below 1975 official poverty 
level ; below 125% of official 
poverty level; below 50% of, - 
A-person family median income. 
(2) Below 1975 "alternate" poverty 
level i- below 125% of alternate 
poverty'4eyeli below 50% of 
4-person family median income, 
(all measures included totals as ' 
well as number of persons" in 
families headed by females) • 



Rationale or HvpotKcflia' 

-The higher^'the proportion of poor^ 
the] greater the competition for 
jobs in low-skilled, >en|try level, 
positions. , t 

-If more people are at or below 

^poverty, AFDC caseloads and numbers 
of WIN registran|:s wiir be gri^ter; 

-As the size of the WIN prograi^ grows, 
the more dlffleul't it may become to 
place registrants. 

-A bigger AFDC caseload means High ^ 
~ state social services costs and 
perhaps less funds for supportive^ 
services and training in WIN*. 



Source of Data 

Survey of Income and 
Education,^ 
U.S. Bureau of the 
Census and Department 
of llEW 



Ye^ra^'data 
collected 

1976 • * 



II. ReRlatranfe PenioRraphlc Factora 

Average level of educational 
attainment of WIN regis tranta^.^ 



-The higher the registrant's level of 
educatiqnal attaiiunyanti the more *'Job 
ready" Ht: or she ia*^ 

«*Thoae reeiatranta vlth ,leaa than' a ^ 
hlg|> achool equivalency may require 
mbre ^cdatly aervlcea— counaelingi 
training^ etCs^'^-and will qualify only 
for lower paying Jol>ae 



ESARS^ Table 30 



FY 1977 
FY 1976 and 
TQ 
FY 1975, 



3e Thia factor's poaaible relationahip to wlLN'^performance waa alao auggeated in Wiaemani 1976a 

4« This factor's possible relationahip to WIN performance waa alao auggeated in Levinaon^ 1970; Feldmani 
1972; Thompson and Mllea^ 1972; Schiller » 1972; and Miller and Ferman^ 1972. 



' . . Tabie 50 

Soclc-Bcono«lc factor. llypo'theslMd to Affect P«rf ormince of WIN ProgMw 

(continued) " 



Percentege of toul number of WIN 
regletrente that aromilel/ 



PerceYitege of totel number of WIN 
regiatrantg that are non-vhltel/ 



III. ProRrem t^ctavm 



■> 

Entry level salary of employment 
counselor! and intervlewere, 
relative to prevailing wage in 
the itate 



Nujfiber of WIN staff ("positions 
psld") per 100 registrants 



* Rfttionale or Hvpott^aa^A 

' < ... 

-Mal^s cdntinue. to receive hi^er 
paying jobs in the employment 
market than do women. . 

-State WIN programs with a high 
proportion of male registrants 
(presumably those states with 
APDC-U programs) will make more 
placements in jobs with relatively 
higher joh en^ry wage rates, . 

-Racial inequaliCy still exists in^^ 
ther employment market, 

-State WIN programs Vith a high 
proportion of minority registrants 
will have more difficulty iiiaking 
quality job placeroonts (i.e., high 
wage jobs with long retention). 



''■In states where staff salaries are 
competitive with private industry, 
WIN is more likely to have better 
qualified personnel, which should 
contribute to higher performance. 

-A high ratio of staff to regiotranta 
means more time spent on each 
registrant.' 

-*/IN programs with low caseloada per 
staff may>pend more time working 
toward placements in quality jobs, 



- Source of Data 
ESARS, Table 30 



ESARS, JM^U 




State Salary Surveys . 
U.S. Civil Service 
Conmiasion 



Coat Accounting System ^ 
Report 96 



Years data 

collectpd 

c 

FY 1977 
. FY 1976 and 

TQ 
FY 



FY 1977 
FY 1976 and 
TQ 
FY 1975 



1976 
1975 



FY 1978 
FY 1977 and 
TQ 



WIN .i^eglittantsV* or **avje.rage amount ot tine WIH registrants ^rrent^y 
on- welfare J** Final variables .'are listed in Table SI*. f 

*^ / D§t« on the f our petfoinan& Vieas^riis were obtained 'frdm tables 
in the Wl^ Allocation Foroula used to compute discre^ionaify dollar alloca- 
tions to states for FY 1976, 1977, and 1978» ^ Those "pro^f am data covered 
cal'endar ^years'^CCY) 1974, 197S, and 1976, respectively* Therefore, demo- 
graphic and labor market data 'were collected for ttlo'se three years* If 
ihformatlbn was not available for thode three years ^ data •for*/.the closest 
y6ar were used* The information on registrant demiographics waii taken from 
>the .Employment .Service Ajiitomated Reporting System (ES^RS) reports aVall- 
•al^le in the WIN National^^ .Off ice* Data oh WIN staffing levels were 'ac- 
quired ' firoffl ^he Cost Accounting Systemi (CAS) * 

• • • . .* 

«» ... 

'Hvoo thesis Testing ^u-* 

The hyi^otheses given tti Tattle 50 asaert that aome conalstent pat-* 
texn may exist between envlronmen'lal Variables and performance Indlcato^rs 
acroes state WIN programs* To test these hypotheses t we first examined 
the^-relationshlp^ between Itidlvldual envltonmental variables and Individual 
performance measures for each of the three time peridds <CY 1974» CY 1975^ 
CY 1976) « This simply compared the values of two variables for each state 
* prog ram»«»one ' an environmental variable and the other a perform£lnce measure 
Ij: showed whether > across- all si:ate programs^ there was a discernible and 
significant** relationship between any two variables* ' 

«4 

Although individual environmental factors were correlate4 with 
'each performance measure as a first "test of the hypothesise we assumed, 
that in the real world groups of factors would affect -the meaisures to- 
gether* That l8> a ^number of factors would simultaneously affect eaoh ' 
f performance measure and each, other in a complex interaction* ..r 



*A relationship between these factors and WIN performance was 
hypott»e8ized in Pacif lc/Camil/Ketron>^ 1976* and in Wisema9» 1976* 

^♦^♦"Significance", was defined "in terms of a 90 percent confidence 
level o That Ist we would bcrlieve the as'sociation between an environmental 
Variable and a performance measure shown by the correld^tion analysis If 
there was a| 10 percent chance or less that the association waa» in factt 
zero • • • , 
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SUte Lfevel Varlablea* * • 

* « ■ • » • • ^ • • 

■ ■ . - t 

Variable ^ » / . . " , 

" Compla'te Variable Definition • ' ^ T- * 

or . . Number of WIN Jol) entries per sponsor staff for twelve 
sioatns w 

• > . . .- • ■ • i ^ 

02 



03 



05 

-06 



■ . 08 



' Average monthly welfare grant reductiona. eg a propor- . 
tlon of average monthly grant costis for WIN reglstrantk 

' Average retention rate of WIN jol). entries 

04 Average WIN job entry hourly wage rate, as a oroportion 

' of prevailing hourly wage ■ - F^^^^on 

" Labor force participation rate • 

Female labor force participation rate ' 

07 Non-white labor force participation rate * " ' 

Percent ^^non-agricultural employment unionized' 

' 0? Population density (per square mile) * 



XI 



13 ^ Average weekly earnings of p^roduction workers'^n marifltactur 
, ing payrolls 



0 " f 



\ 10 Percent of population in me^opolitan areas with popula- 

>/ tion between 100^00 and 2j50,000 . ^ r r 



Percent .<^f population ^Ln metropolitan areas with popula- 
tion over 250,000' . 



.:12 Average hourly earnings of production workers on manufactur 

ing payrolls ^ , . 



(CY 1974'^iQ7s ^'g'^.^Phlc data wer^ collected'for three years 

and 1978* ^^^^'^"'^ ^"^ram data were collected for FY 1976. 1977 



Table 51 (oontinued} 



Variable 
Number 

14. , 



15 
16 
17 
18 

19« 

20 

•21 

22- 
23 

24 

25 

26 

> 

27 



'. Complete Variable Definition 

Number of individuals unemployed, as a percentage of total 
■number unemployed in' the nation 

Official unemployment rate . • 

Percent of population below official poverty level 

t v 

Percent of population below 125X of official poverty level 

Percent of population beluw 50% of official median 
, family Income ^ '•^ 

Percent of persons in female-headed families belov 
official poverty level 

Perceut of persons in female-headed families below 
25% of official poverty, level 

Percent of persons in female-headed families below 
50% of official meciian family income 

Percent of population below alternate poverty level 

Percent of poj^ulation below 125% of alternate poverty \ 
level 

Percent oi population below 50% of alternate median 
f ^lly income s . 

Percent of persons in female-headed families below 
alternate poverty level 

* 

Percent of persons in female-headed families below 
125% of alternate pov ".y level 

Percent of persons in ::emale-headed families belov 
50% of alternate median income 
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Table 51 (continued) 



Complete Variable Definition 

Average size of employer units reporting under state 
unemployment insurance programs 

Percentage change in total number of Employees on non- 
af.«ricultural payrolls from one year to^ the next 

Percent of non-agricultural employment \in lowage 
industries l 

Number of WIN Sponsor staff per 100 WIN* registrants 

Percent of WIN registrants who are males 

Percent of WIN registrants who are minority 

Percent of WIN registrants with 12 or more years of school 

Entry level weekly salary of "Employment Security Inter- 
viewer", as a proportion of prevailing wage * 

Entry level weekly salary of "Employment Counselor", as 
a proportion of prevailing wage 
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Hence, we* next tested* our hypothesea using .step-wise multiple 
regreesion* Each o£ the four performance measures was regressed against 
several environmental factors to discover which group of factors best "ex- 
plained** variation in this measure among' s.tat<^ WIN programs. Only en-- 
vironmental factors which had fitat passed the correlation test mentioned 
above were "inclyded ,in this analysis. The question was which of the fac-' 
tors would continue to show a sign.ificant association with each performance 
measure when combined with other factors.* 

In certain respects, this analysis was derived from similar re- 
search on other employment and training programs. Previous -studies had 
shown connections between the placement rates of state employment security"^ 
agencies (SESA's) or local employment service (ES) offices and their labor 
market conditions or client demographics*** However, this was the first 
time such an approach had been applied to WIN. 

This, WIN analysis differed from the employment service studies in 
severdl respects. The ES studies had used a single performan'ce measure-*- 
individuals placed per staff year. Here, four Indicators were used and 
a composite measure derived. Most of the ES studies had been based on 
data for a single year only.*** Here three years were examined. Also, 



*Conventlonal F-tests were used to Judge the significance of the 
overall equations and regression coefficients for the individual variables. 

**For a detailed disciission of similar research conducted by E. F. 
Shelley and Company, the Center for Applied Manpower Research, Dr. Fred 
Englander, and Westat, Inc., see Chadwln et al .. May 1977. 

***The exception Is the Shelley study. Development of. Performance 
Standards for ES . which considered two years' data. ~ 
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our analyslB used nlore exacting statistical tests ihan wera! applied In 
the ES studies.* » , / / 

The follovlag subsections describe our/correlatlon and regression 
analysis In detail. / ■ . | 

Blvarlate Correlati on Analysis . Co'rrelati<4 analysis yas performed to 
teat the strength aid direction of the relationships amongrall the ex- 
ogenous variables acid' all four performajice measures. Scatter diagram 
printouts were also generated to Indicate the form of the's'e relationships, 
that Is, whether thiey were totally unrelated, linear or curvilinear.** 
Data were analyzed /separately for' three twelve-month time (periods. These 
time periods were /(I) CY 1974, (2X CY 1975, and (3) April!l976 through 
March 1977. The/ c'd^rreaponded to^ the three reporting periods used for 
"WIN allocations/ for FY 1976, FY/1977, and FY 1978, respectively. The 
correlation b^ween individual environmental variables ank individual 



1. 



*7?he state-level, analysis discussed in this section was accom- 
plished under tight deadlines and with limited resources^ Its major ' 
purpose was to assist ;us in selecting high and low performing state WIN 
programs for field research and study. The local-level" data analysis 
presented in Section 4 of this appendix did not hav^ such tight time and 
resource constraijtts . Therefore, it Involved more thorough univariate, 
blvarlate and multivariate analysis, and data 'examination and testing of 
the assumptions underlying the statistical analysis. State-level analysis 
invo.lved Initially distributional statistics and graphics on variables 
and examinations of scatter diagrams to detect outlying values and poly- 
nomial relationships among independent and dependent vaifiables. In our 
blvarlate and multivariate analyses we were sensitive to the Influence 
of outlying values on derived regression equations (especially where 
outlying values were found for a number of variables deacribing a single 
'^tate operation or its environment). Our analysis also i-addressed the 
existence of excessive multicollinearity and heteroskedastlcity. State- 
level data will undergo additional analysis in our study of alternative 
WIN allocation procedures. These would include further analysis of re- 
siduals and other statistical procedures besides multiple regression. 

**Some relationships did exhibit a somewhat polynomial" form in 
scatter diagram displays. However, these curvilinear relationships were 
not statistically signif leant with the numbers of observations (51) we 
•used. We hypothesize that for n's greater than 51 (e.g., randomly se- 
lected local WIN operations) some of these relationships might in fact ' 
prove curvilinear. 
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performance measures was examined for each of the three time per lotis, 
based on data for 51 state programs.* The purpose of this analysis was 
to identify i^ich environmental variables were aignificantiy correlated 
(at the •! level or greater) with each of the performance measures* This 
was.used in initial decisions on variables to be included in the multi- 
variate regression analysis. ' 

• t 

For the sake of simplicity, we hid hoped that the same exogenous 
factors would prove significant explainers of each of the four performance 
measures. The. results of the correlation analysis revealed a much more 
complex picture. Each of the fqur' performance measures was associated 
with a different group of environmental factors. 

Table 2 (Chapter 2) sliowed those factora that proved to be sig- 
nificantly correlated with each performan'ce indicator at the state level 
and whether the relationship was positive (+) or negative (-) . As that 
table shows, each of the four measures was associated with different en- 
vltonmental factors. This had Implleatlona for our multivariate analysis 
that is discussed below. Only one factor — prevailing wage— appeared re- 
lated to all the measures, and this provided insight into the complexity 
involved. Prevailing wage was positively related to the number of job 
entries per staff and to welfare grant reductions. But it was negatively 
related to retention rate and WIN job entry wage rate.** 
\ 

Too much importance should not be attached to the relative strengths 
of correlation coefficients presented. They measure the associations be- 
tween .one environmental variable and a performance ineasure in the absence, 
of other environmental factors. When other, explanatory factors are .added, 
as in multiple regression analysis, somrj of the" performance variation 
attributable to* a factor could instead .be associated more strongly with 
otners. 

In short, by Itself correlation analysis can tend to exaggerate 
the Importance of individual variables. Analysis associating more than 
one factor with a performance measure is more realistic. For this reason. 



*Correlatlon matrices for each of the years studied showing rela- 
tionships among all the independent and dependent variables are presented 
in Nightingale and Mitchell (1978). 

**In fact the correlation with WIN job entry wage Is spurious since 
the independent variable, prevailing wage, appears in the denominator of 
the dependent variable (WIN job entry wage rate). It does* not, therefore, 
appear on Table 2 . For further discussion of the WIN performance meas- 
ures (quality vs. quantity), see Mitchell et al . (1977b). 



311 



we viewed the correlation analysis prlnarlly as a'^est to Identify .lm<- 
P9rtant environmental factors for the multivariate analysis discusied* 
next and to Idehtlfy interrelationships amoiig ^Independent variables that • 
would have to be considered in our multiple regressions. 

Multiva r iate Analvsla » While bl-varlate correlation analysis is useful as 
a preliminary step in identifying the type and direction of relationships 
\between two variables, it does not provide an understanding of the multiple 
environmental influences on WIN performance found in real world operations. 
The values of one environmental variable might be confounded, with those of 
other environmental variables. Therefore, as stated in Section 1 of this* 
appendix, we next used multiple regression analysis to estimate the cdm-> 
blned -effect of socio-economic environmental factors on measures of short- 
run program performance. These performance variables were regressed on 
seta of Independent variables hypothesized to influence the effectiveness 
^'^^ programs. The regression took the form presented on page 270. 

For each of three year^ multiple regxfission w&s used to analyze 
the •relationship between performance and environment. Since, these WIN 
performance indicators did not have equal policy weights according to 
national WIN officials and oUr analysis of the discretionary portion of 
the allocation formula, we conducted separate regression analyses for- 
each of the four measures. £ach performance measure was regressed agalifst 
several environmental factors to discover- the combination of factors that 
best explained variation in performance at the state level for each meas- 
ure and each year. - We used a stepwise deletion procedure to eliminate - 
sequentially those Independent variables that were not statistically alg- 
nificant at the .05 level or less.* - 

• ' . • » 

the resulting regression equations served, two closely related pur- 
poses. Each equation, estimated the manner and extent to which a measure 
was affected by environmental Influences beyond the control of WIN program' 

*A 95 percent confidence level, as measured by two-tail F-tests, 
was required for individual factors to have been included in final equa- 
tions. Table 50 showed that we had specific expectations about the di- 
rection of relationship (positiVe or negative) tliat would show 'up between 
many of. pur environmental factors and WIN performance variables. These 
expectations would Justify using a less exacting form of F-test than if 
we could not posit the direction of Influence (in technical terms, a "one- 
tall" rather than "two-tail" test). However, we. required that«a variable 
jpass the more exacting form of test used wh^n there is no expectation 
of direction (the "two- tail" test) for at least one of the three years i 
under examination. * 
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8ta££« Thesft equations aXao provided ut with a way of ."controlling ,£or" 
environmental Influences on performance differentials and In so doing 
ld4«t.lfylng and sel«ctlng for study state WIN proftramv that were signifi- 
cantly high or low performers given their envlronmei^t • Regressions pro^ 
vlded us with a measure (the 9oefflclent of determination— R ) of. the 
.cumulative capability of a set of environmental varld>les best able to 
predict variation In retention rates, job entry wage rates. Job entries 
per staff and welfare savings*. 

The results of this analysis were presented In Table 3 (Chap- 
ter 2). The environmental factors^ shown best explained variation In per- 
formance at the state level for each measure and each year. For example, 
two variables taken together—proportion of employment In low-wage Indus- 
tries and proportion of WIN registrants that are male— explained 32 percent 
and 23.4 percent of the variation (adjusted R ) In the average WIN/job 
entry wage rate In FY 1977 and FY 1978, respectively.: 

Several Important results are readily apparent. First, the same 
sets of factors showed up as the most powerful explainers of the same per- 
formance measures each year, with only two exceptions^.* The llhkages 
between performance and environmental factors are, for the most 'part, 
consistent over time. Second, the environmental factors that have the 
greatest influence are not the same for each of the four performance meas- 
ures. Third, certain performance indicators seem most Influenced by labor 
market conditions, while others are more sensitive to registrant charac- 
teristics. Of particular interest is the fact that the number of Job 
entries per staff and Job retention rate appear most heavily influenced 
by registrant characteristics, namely, the proportion of registrants who 
were high school, graduates or who were non-white. Fourth, environmental 
factors explain up to 44 percent of the 'performance variation among state 
programs^ . « 



^^^^^^^^^^ H 

*The recession of 1974 evidently seriously affected the number 
of Job entries per WIN staff foi; FY 1976 allocations. None of the asso- 
ciations which were strong in FY 1977 and FY 1978 held up for FY 1976. 
Second, the FY 1978 allocation formula changed the method of calculating 
retention rate, and this appears to have brought different factors Into 
prominence as explainers of retention rate for FY 1978. 
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Identifying Hltth a nd Low Performing State Programs 

The main objective of our reeeerch effort waa to examine the or- 
ganizational and Institutional difference* in high and low perfon>ring 
programs i Thus, We wanted' to select a group of states in those two per- ' 
formance categories. The above quantitative analysis not only estimated 
the extent to which each performance measure was affected at the state 
level by socio-economic environment . It e^Uo provided a way to control 
for important socio-economic differences In assessing state performance.. 

The final tegrerfslbn equation for each measure was used to e^stlmate 
the expected level of performance for each state, given the ^economic' and \^ 
social conditions in that state. Each regression equation' posited a linear 
relationship between one of the four performance measures and two or three 
environmental factors in each of the.yfears examined. These equations - 
showed the expected relationship on the basis of data from all the states. 
What any one state's expected. performance on, this measure would «have been 
in a year was estimated by "inserting" that state's data into the equation. 
The equation then estimated how this state would have done on this perform- 
ance measure in this year if the relationships between the env.ironmeptal 
factors and performance had been the same in this state as they had been, 
on average, nationwide. The estimated performance level was termed the 
state's "expected" performance. ' - . 

> . ■ . 

Of course, the state's actual performance on the measure' during 
that, year was known and differed frotn the estimate. The direction and 
size of the difference were used as criteria for selecting state programs 
for study. We hypothesized that these differences were due partly to' 
the influence of program variables, such as organizational structure and 
location, the w.ay in which program resources were managed and the nature 
of WIN sponsor and^ SAU linkages.* 

. States that had performed significantly bejtter than would have 
been expected given their environments were assumed to have done so be- 
cause their WIN programs had been well organized and run. States which 
had performed significantly below what had been expected, were assumed to 



\ 



*Some of this "unexplained" variation might have been due also ' 
to environmental factors that were imperfectly measured or for which data 
were unavailable. Some variation could also have been due to environmental 
factors that we had failed to Identify as important during our hypothesis ^ 
development phase. In addition, measurement and sampling errors were pre- 
sumably contributing to the proportion of performance variation that had 
not been associated with environmental differences among state programs. 
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be less effectively organtseU end o^rereted* The point: of field research • 
was to study the prograas in these st.ates and diacove^' the Structural . and 
behavioral reaa^ne why perf9na;ice exeaeded or fell ahort of expec[tationa« 

In picking states for atudy, however, caution was needed. The 
estimates of expected perfomance generated by thp regession equations 
were only approxinations,^ subject to the llaltations of our assumptions 
and statistical -procedures. The equations were basjBd on a limited number 
of observations (51 -WIN programs) and the data used were subject to error* 
We could only state with a relatively high level of confidence that the 
"expe,cted" performance of a given state fell within ^ certain rang^e of 
'values provided by our analysis., Only 8t#t6s whose actual performance was 
outside this range could be -said to. deviate significantly from expected 
performance. States whose actvial performance on a particular measure 
exceeded the estimate by more than this range we defined as "high per- 
formers," while those whose actual performance, fell short of expected by 
more than the range we termed "low performers."* 

We' found that no single state was a high or low performer on all 
four performance measures. In fact, very few proved to be either' high or 
lt)w on more than one measure. Many of the states that performed better 
than expected on job entries per staff were lower than expected on reten- 
tion rate and job entry wage— and vice versa.** 



*The range was defined using the standard error of the estimate. 
A regression equation defines a linear relationship between some set of 
independent variables and the dependent variable. Because of statistical' 
uncertainty, the actual regression line may differ somewhat from that 
defined by the equation. The standard error of the estimate defines an 
error band around the line within which the "real" line can be assured 
'to lie, at a certain level of confidence.' 

In our analysis, we required „that a state's performance results 
exceed Its estimated performance by at least one standard error of the 
estimate before that state was defined as a "high performer." Similarly, 
only a state whose actual perfomance was at least one standard error 
of the estimate less than its expected level was defined as a "low per- 
former." 

**See Nightingale and Mitchell (1978) for tables showing the rela- 
tive effectiveness of state WIN programs on the four performance indicators 
for FY*sl976, 1977 and 1978. 
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Ttkeac results- wre not surprising* The tour messureso-retsn* 
I >• tlon rate, job entry wagVrate, number b£ job entries and welfare grant 

' reductlons^'^ifsre tofvj /itg degrees fton^edtt^leaantary* The number job', 
entries was Xargisly a v easure of quantity * Reteiitlon rates and Jobi entry 
wage rates described the quaaitv o£ the jobs In which WIN registrants 
were placed.* Welfare grant i^uctlons^ measured welfare savings and re- 
aulted from both this number and' quality of placements*,, 

TJierefore, we hypothesized that the quantity and quality placement 
of objectives of WIN might work against each other* Increasing the "number 
of WIN registrants placed could lead to emphasizing "quick aiid easy" job 
entries— relatively low-paid jobs ln\^8econdary labor markets with high 
turnover rates, and low job security* \tH1s ran counter to a quallty-of- „ 
placement goal* Conversely, emphasizing quality*- making the placements 
' that a^e likely to last 30 or more daysVand at relatively high wage rates — *' 
required a more iabor-lntenslve placement effort * This extra effort meant 
fewer total job entries, contrary to the yiuantlty-of-piacem'ent goal. With 
the qualitative and quantitative objectives substantially In opposition. 
It was not surprising that no state programs were high performers on all 
four measures** ^ 

However, these results' complicated our task of Identifying sets of 
high and low performing states for field work and study* Which measure-- 
or combination of measures— should be used to separate high from low per- 
formers? As noted earlier, the question was resolved In close consultation , 
with officials of the WIN National Office* It was agreed that we should 
weight the four measures, according to th^lr relative Importance in deter- 
mining discretionary allocations .to states; as was revealed., in our analysis 
of the WIN Allocation Formula** We therefore defined the'overall effec- 
tiveness of a WIN operation as follows: ' - 



*One o£ the options rejected by National 0££lce administrators 
Involved weighting all £our Indicators equally* Such a strategy o£ equal 
policy weightings would/have permitted us to have statistically cabined 
these £our per£ormance measures Into & single unmeasured » scalar per£ona"<- 
ance Indicator* This option was £oreclosed by national o££lclals and 
sta££s In addition to policy weighting complications t program 8ta££ at 
all levels would have had greater dl££lculty relating to some "abstract** 
* scalar 8Co,re o£ performance rather than the much more famlllj^r Job entry- 
related measures* ' c 
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Overall • ,A 



^ t Tl)e constants A, B, C ahd D are the approximate policy weights / 

assigned to each indicator as derived from our analysis oi the WIN alio* 
. cation formula and from consultation .vlth the n&tlonal WIN official's** 



A - 15.0 

B - 7*5 

C - B.3 

D - 7*5 



^ ^ The ratio of actuar performance (based on national prbgrdm report*- 
Ing data) to expected performance (based on the regression equation) de*» 
scribed to vihat extent progriuns exceeded or fell below estimated levelst 
To obtain a weighted performance score for each state, these .ratios were 
then multiplied by the policy weights* Thus, the overall {Performance, 
index, based on the weighted ratios , would be; 



tfltcttventM 



/ 



/ As^ l*^:'} ^^'"-^ \ 



^A) ^KxpacteiT retenelony ^ yExpoeted job entries p*t 



•caff \ / 



Actual job entry wae V 
^Bxpecetd Job entry, vagey 



( Actual weUaf aavln^i 



^ (D) \|^pecte4 ^Ifara aavingt 



J. The weighted overall effectiveness index was standardized by mult 1-* 
plying by 100, then dividing by the total of the four weights (38.3)« The 
result was a composite standardlged performance measure for each atate > 
This process was repeated for all three years* 



^See'Table 1 (Chapter 2) for the policy weights as derived by 
simulation analyses of the WIN Allocation Formula* This part of the 
formula la, in effect, a stat^ement of current national performance pri«- 
oritles* 
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The cotnposlte scdrea for all statw were .then ranked fot each of 
the* three years, In a given year, states which were in the top 25 per'cjsnt 
of the range of. all scores were deeae'd to be "hlgh.pjisrformets" In terns, 
of the composite- scores, %jiUe states' in the bottom 25 percent vkre deemed 
^:o tie "iow performers."* 

- . . ■ • , . ■ . ' • ^ ' 

The final selection of sample states considered th^ rankings for 
all three years « States were Identified which were consistently high or 
low performers. Others could be seen to lie rising Into the high perform- 
ance, range, or dropping Into the low performance range y although they were 
not In these. rangejB ^1 1 three years/ High and low performers defined in 
these terms ^provided the pool of states .from ^whlch the sample was drawn. 

The quantitative analysls^^was the main, but not the ionly, basis 
for selecting the eaiiple states.' -We wanted' our sample to include states 
that were clearly hlghXand low performerjs in the above kense, since con- 
nections! be tweetf perfor^nce and institutional structure and behavior 
were more likely, to be pereep,tlble_ln ^ro^grj^m&.^wai?d these extremes. 
In addition, two other criteria enter'ed in,, both wor^ng to ensure that 
the sample would be broadly representative of WIN progt^s nStiohwide. 

One was that pairs ofc high and low. performing states should be 
drawn, if possible, from the same regions; There were regWal and cul- 
tural differences wh'ich we "hypothesised might affect WIN performance and 
which were not captured' fully in our' analysis of economic. and demographic 
Influences. One example was variation in attitudes toward welfare from 
region to region. -The "clustering" of high and low performers^ regionally 
gav? us a rough way to' control for these Influences, since performance^ 
differences among states in the same 'region would be less likely to be 
due to geographic or cultural differences,. ' , • 

^ The second consideration was that the sample states should exhibit 
a wide range of organizational arrangements in their WIN programs. Identl 
fication of associations between institutional characteristics and ' 

'. * ' 

*The method used for indexing and selecting is only one of sev- 
eral possible ways of presenting this data. The standardization could 
be scalar, to better measure the "distance" from one state's score to 
another. Similarly, we originally planned to define high performers as 
those states which were more than one- standard error unit above expected, 
but since there were two, or thrfee programs way above the range, thus 
pushing the standard error up, we decided to use the 25 percent method 
described above. 
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performance was more probable^ stated' at the extremes 'of performance were 
examined* Similarly, connections between structure and performance would 
1)e clearet if the sample contained, a lot of variation in institutional 
'features/ Henc^, we sought states that were not only hfgh or low performers 
but representative of nationwide differences in program size, organizational 
structure, ''sponsoring** agency, degree of collocation and Integration, and 
s^ervice delivery approach (team, caseload, etct)t Information on structural 
differences was gleaned from three sources—our mall survey of all state 
WIN sponsor coordinators,, a telephone survey of all WIN regional ^coprdinatbrs 
^and our National Of fiqe interviews* 

Our final sample of«ten states substantially met all these criteria* 
All the states were hdgh or low performers as defined above* The sample 
was also geographically clustered and representative* Eight of. the states 
were matched in pairs of high and low ^performers covering four different 
regions— the Industrial East , the Industrial -Midwest, the South, and^ the. 

West.* ,y ' ' r * . * X * 

^ • • ' • t> 

The states were also diverse and . representative in terms of size 
. anci structural variation* Three were "megastates" with big WIN prog^Ws, 
while four were small states, several with populations .thinly dispersed 
over rural areas* Vid^ ranges of organizational arrangements, degrees ^ 
of collocation or integration, and service delivery approach jwere cx^vefed* 

Our state coordinator surv^e^^showed that, 41 of the 52 WIN programs 
were sponsored by state department*s%f labor or employment security agen- 
cies arid, eight by umbrella (often "human resources'*) agepcles* Two were 
housed in governors'"^ manpower office's that had state^leyel CETA reasons!- 
blllti)^s, and one delivered servicis- through the state welfare departthent* 
Reflecting this vari^^ty^ our sample .included three umbrella agencies, and 
the wel^are*»run program as well as f Ive ,6ESA«operated programs* In addi<r* 
tlon, provision had been made to examine the only two sites In the nation 
where WI(^ had been operated by local CETA.p^ime sponsors* 

• ♦ • * . , ' 

Definitional differences clouded the accuracy of data in our 'surve], 
on collocation and Integration of ES-WIN and SAU staff* However, responses 
indicated that, despite federal encouragement, only seven of 52 programs 

were collocated at the state central office level* Two of these were tn^ 

* * 

eluded In our sample* ^ ' . 

^ ^ 

*To encourage respondents to speak freely, names of the states 
studied were not publicly disclosed* 
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Only about 15 States Indicated that dhx of. their local units weYe 
both collocated and integrated* Moat of these Indicated that fewer than 
40 percent of their unltsi wcra^ fully combined. However, sly repovted that 
between «0 percent and 100 percent of their Ibqal units were collocated 
and' Integrated • Our sample Included two states that reported many unified 
local operations and several others that were extonalvelyi collocated but ' 
not fully Integrated. * , • 

Despite federal directives to drop the "team" approac'h to service 
delivery, survey responses indicated that a substantial minority of pro- 
grams still- relied heavily on it. Twelve states ^ndlcatjELd that half or 
more of the local ynits were structured this way'. Our sample Included 
three of these, as well as states that appeared to use various mlxes.jol ' 
the functional or caseload approaches. * ' * , 

Our analysis of WIN performance indicators provided a standard ' 
by which to compare state WIN programs. The analysis reported in this 
section showed the assoaation between variations in th^se performance . 
levels among states and differences In ttelr socio-economic environments. 
The -next section addresses such relationships at a more disaggregated . • 
level-r influences of local environmental factors oiuthe. petformance of 
214 local WIN units in our study sampl«e of ten states.. « , . 

4. Effect of Socio-Economic Environment 

on Local WIN Productivity ' ' ^ 

Analysis similar to that just described was c6nd.ucted with local 
levpl data. The purpose was' U) 'to identify high and low performing' local ^' 
WIN units within our study, states and (2) to verify and further explore 
the relationships between environment' and progr^ performa&e Indicated 
by the «tate level analysis. .-This- section discusses the local level sta- 
tist leal analysis. , " ' • ^ 

Local Data Collection I '•',,* 

^Performance, demographic- and .economic information was obtained 
for all 214 local ^WIN. uti its in the ten" study states." Within each state," 
we ^collected data oh the same variables for comparable time periods (CY • 
1977 or FY 1978 for most variab'ee). Tlie local data base therefore con- " 
talned performance and exogenous variables for all local units in the > / 
ten states and was slmlj-ar to that^used in the, state level analysis de-' 
scribed in the. preceding section. ' • " , ' . ^ 

The local data base 'did differ from the earlier data, howevor, 
in two important ways. fXr-st, the unit analysis wad 214 local pro- 
grams rather than 51 state programs. The • Increased number of oboerva-i 
t Ions makes Stat IsfrLcal analysis and results more r^lable. Second, 
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state level data were obtained from national labor market Information 
sources and aggregated reporting data. The local labor maket data were 
only available through the states, usually the SESA research and statis- 
tics units. The program Information was taken directly from local project 
tables In ESARS, CAS and SAU reports, available through the state WIN' 
sponsor and SAU offices or other state agencies. Table 52 lists the 
socio-economic and program variables that were Included In the local level 
statistical analysis. 

This' local data base of 214 units was used to conduct extensive 
statistical analysis, with four main objectives: , ' 



6 Identify exogenous factors associated , at the local 
level with each of the four program performance 
measures. 

* ♦ • 

Determine overall weighted effectiveness Indices for . 
214 local units. 

• Categorize by performance level the 43 local pro- < 
« grams that were visited and In^tensively examined. 

• Develop a preliminary path analysis model, based on 
the results of the detailed statistical analysis, de- 
scribing relationships among socio-economic, organi- 

^ zational and performance variables in WIN. 

Relationships between Socio-economic Factors and Local WIN Performance 

The initial step in, identifying associations between exogenous 
variables and local WIN performance was correlation analysis. Table 53 
presents the correlations between socio-economic variables and each of 
the four performance measures. It 'should be noted here that the correla- 
tions and all subsequent statistics were based on 188 of the 214 observa- 
tions. Data from one state (26 -units) had to be dropped from analysis, 
since careful examination of vaiyLidity tests on correlation and later re- 
gression statis-t.ics repeatedly identified fhe local observations in this 
state as "outliers" in the analysis. The data f^om that state were not 
comparable to data from the other nine states, fo^ two reasons: 

(1) Industrial confidentiality in the employment and 
wa^e reports resulted in incomplete or unavailable 
wage, employment and industrial' profile data for 
several counties, '^hls affected two independent 
variables (prevailing wage and lowwage employ- 
ment) and one performance measure (job entry wage/ 
prevailing wage). 
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Table 52 

Local Level Variables , - ' 

Variable Definition 

Average employer size 

Proportion of non-agricultural employment In low-wage industries 
, Average prevailing hourly wage ' 
. Population density 

Labor force particilation rate 

Unemployment rate-^ 

Number of sponsor staff for 100 WIN registrants 
Proportion of WIN registrants that are minority 
Proportion of WIN registrants that are m^le ' 

Proportion of WIN registrants with 12 or more years of schooling 
Percent average annual growth in non-agricultural employment 
Percent of families below low- income level 1970 
Average hourly WIN Job entry wage 

Number of SAU staff positions per 100 WIN registrants 
Number of certifications made per SAU staff 
Proportion of WIN registrants aged 45 or more 
Total numnber of WIN s'ponsor staff 

Average WIN job entry hourly wage as a proportion of 
prevailing hourly wage 

Number of job entries per WIN sponsor staff 
WIN job entry retention rate 

Average monthly welfare grant reductions as a proportion of 
average monthly welfare grant costs 



Table 53 

Assoclatlona between I.nral ut n Performance Anrf 
.S^clo«economlc Factor s (Correlation Coef f tc^«.n^») 



Performance Meaaurea 



Independent Pa rtnr 

Employer -Size 

Low-wage Indua tries 

Prevailing Wage 

Population Denaity 

Labor Force Participation Rate 

Unemployment Rate 

?finority Reglatrants 

?Iale Regiatranta , 

High Education Registrants 

^on-agricul. Employment Growth 

Poverty Population 

Sponsor Staff/100 Registrants ' 

SAU Staff/ 100 Registrants 

•*umber Sponsor Staff 

Older Regiatranta 

Job Entriea Per Staff 

Welfare Grant Reduction 

Retention Rate 

Job Entry Wage/Prevailing Wage 



Job entriea Per Welfare Grant 



SDOnsor Staff 


Keouctions 


Rate 


.261* 


1 OA 


-•036 


-.234* 




-•088 


;385* 

• *^ w ^ 




• 150 


-.125 




-•179 


.068 


— •IJO 


-^•087 


.123 


• loo 


.202* 


-.278* 


-•393* 


*-.194* 


.302* 




.112 


.326* 


.261* 


.138 


-.138 


-.132 


-.072 


-.404* 


-.499* 


-.073 


-.354* 


.227* 


.144 


-.157 


.295* 


.137 


-.241* 


-.162 


-.182 


-.246* 


-.466* 


-.057 




.622* * 


il92* 


.622* 




.430* 


.192 


.430* 




-.^29* 


-.446* 


" .111 



Job Entry Wage/ 
Prevailing Jfagft 

-.546* 
.474* 
-.753* ' 
-.172 
.018 
.072 
.062 
'.041 
.213 
.281* 
.426* 
.264* 
.025^. 
.226 
.038 
.229* 
.446 • 
.111 



/ 



(n - 188. 



Coefficients marked with aateriak were algnif leant at the .01 
level or better.] 
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(2) The state had Just begun using ESARSrreports £or 

all local projects* Our research schedule coincided 
wlt4^the transition period from manual transaction 
reporting (TWX) to ESARS. Since only three months 
of ESARS data was available, the program Informa- 
tion for this state was not comparable^ to the 
other nine 'states « This affected the i^eglstrant 
. demographic variables, number of Job entries and 
retention rate* ' 

As Tab^e 4 In Chapter 2 showed, many of . the same relationships; 
that appeared significant at the *8tate level were also observed at the 
local level. That Is, relationships that were observed with ''state level 
data also appealed wl>en data oq local units were examined. The Signi- 
ficance of the characteristics of WIN clients was again obvious, par- 
ticularly when looking at the number of job entries per staff and welfare% 
savings. Offices that had high numl^ers erf males or high school graduates 
in their regiptrant pool achieved high levels on three performance meas- 
ures. Similarly, offices with* high proportions of older workers or minor- 
ities had lower Job ^entries per staff , welfare savings and retention rates. 

After the correlations, multivariate analysis was conducted to 
identify the combination of factors that best explained variation ,i|i each 
measure at the local level Two types of llst-wlsj regressions were con- 
ducted for each performance measure. First, all the scjcio-economlc vari- 
ables were regressed against each perfprma'nce measure. Then, restricted 
regressions were used including only those environmental factors that 
significantly explained variation in ^the perfona.ance measures.* Restrict- 
ing the regression' equations permitted high levels of confidence to be 
placed In the resulting predictions of performance levels. 

^ During the^rocess of identifying the equations that best explained 
^performance variaxion., certain critical assumptions were tested at every, 
step in the regression analysis, ^dn^^elatiou matrices and scatter diagrams 



*Slgnlflcant explainers were those variables that had regression 
coefficients with F-ratio values greater than the critical values fur 
a two-tail 5 percent F-distribution test for gignif tcance. A variable 
was not included if it was correlated above .30 with any other independent 
variable in the equation. 
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were examined to. Identify any possible curvlllnearlty in associations 
among variables or significant Interrelationships among predictor 
variables. * In addition* sltice thc» existence of polynomial and inter- 
active relationship's among variables would have Important implications 
for ourianal7sls in general and for path 'a;ialysis in particular, we » 
lncl.ude4 such terms in test regression runs'* Inclusions of such terms 
did not Improve the predictive power of our regression equations* 
Another critical assumption underlying the analysis is that the error 
components for each equation are normally distributed around a mekn 
of zero** The tests for no.rmal distribution of residuals were conducted 
by examining the frequency distribution of residuals* 

« 

Another assumption Is that the residuals have the same variance* 
^Uhen this assumption Is violated » the residuals are heteroskedastlc* Safe* 
guards ag^alnst heteroskedastlclty were built into bur analysis In the de-- 
sign phase by standardizing variables to minimize the influence of scale 
across observations. However » as a further precaution given that we were 
using cross-sectional data» tests for heteroskedastlclty were conducted. 
These tests involved scatter diagrams of residual values of each equation 
against each^of the Independent variables used in the equation. If an 
association appeared betweeA the error terms and variables, a Bartlett 
teat was condircted to determine whether the level of hetetoskedaclty was 
significant enough to warrant data transformation, standardization or 
ellmlnatlotlfc - , 

Finally, the assumption of non- linearity of residual values was 
tested* Systematic associations between residuals and independent of 
residual values variables would indicate that the residuals are related 
to each other systematically through some mediary variable. Tests for 
linearity included scatter diagrams of residuals and independent variables 
and examination of bivariate correlation statistics. 

All of these assumptions were tested for each gf-" the flna\ re- 
gression e'quatlons. The best predictive equations for each of the^our 
performance measures appeared in Table 5 (Chapter 2). 



*Thls assumption ensures the validity of tests of hypotheses 
(eege« F-tests) for small samples. Since our sample was relatively large 
(125 to 241 observations), this assumption Is not that critical, and the 
central limit theorem estabHshes the approximate distribution of our 
sample statistics. Also tht. assumption of a zero mean was necessarily 
met since the constant term In a linear regression equation always takes 
a value that ensures that the mean of the error terms is zero* 
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2 Th« results In Table 5 show that the predictive power (adjusted 
R ) is higher at the local Uvel than had been found at the state level 
(Table 3 in Chapter 2), with the excepclon of retintion rate. Further 
validity and reliability tests of the data revealed the severity of the 
retention rate reporting problem which was ttehtioned e^lier in Ch^ipter 2. 
The problem was traced and identified as being inconsistent reporting (or 
correction) of the items in ESAKS used to compute retention rate. This 
problem had not be^en as obvious in the state ^level analysis, since thfe 
data was more aggregated, thus somewhat canceling out local reporting 
inconsistencies. 

, This was a very critical finding and required two major modifica- 

tions in the next steps in our analysis. First, two sets of composite 
local performance indices were developed, jone Including retention rate and 
one excluding it, in order to compare the rankings. Second, alternative 
path diagrams were tested, one excluding retention rate since its reli- 
ability was tenuous. These two modifications are discussed in the fol- 
lowing, sections, on local performance indice8^^and preliminary path models. 

The local regression results (Table 5 ) show that labor market 
and demographic conditions explained 52.1 percent pf the variation in 
standardized Job entry wage, 30.4 percent of the variation in Job entries 
per staff, and 42.9 percent of standardized, welfdre grant reductions. ' 
Furthermore,. there was substantial overlap in the explanatory variables 
for the three performance measures. In fact, there were only seven dif- 
ferent Independent variables in the three final equations, most of those 
appearing in at least two of the equations. This was important when de- ' 
veloping later path models which were base4 on the relationships of in- 
dependent and dependent factors. 

It is also significant to note that some independent measures were 
positively influencing one performance measure while negatively Influenc- 
ing another. Employer size, for example, was a positive factor in the 
equation for number of job entries per staff arid a negative factor for - 
welfare grant reductions. Proportion of population below poverty nega- 
tively* affected Job entries per staff and welfare savings, but positively 
Influenced standardized job entry wage. This further emphasizes that 
any given local office could have some positive and some negative environ- 
mental conditions. While some aspect of their labor market may make 
their job difficulty another aspect could be working in their favor. 
By entering each office's local socio-economic data into the regression 
equation these interacting factors are taken into account, thus control- 
ling fof the local environment. . . 
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Performance Ranking of Local Programs In Ten St&tee ^ '" '■ 

The regression equations In Table 5 (Chapter 2) vere used to 
develop standardized cpmposlte performance scores for the 188 local ^WIN 
programs In nine states* The procedure was basically the same as described 
earlier In the development of state performance scores* These scores were> 
again, based on the ratio of actual performance to estimated expected per*-' 
formance and weighted by the policy factors*. ^ 

High performing local units were Identified as those which scored 
in the top 25 percent range of scores from all the offices In one or both 
of the rankings** The 43 local programs we visited were then categorized ' 
according to their performance in these rankings of 188 offices* The 
four programs in the state that was dropped from analysis were categ6tlzed 
according to their actual performance levels and to their ranking within 
the state t since within state the data and analyses were comparable* These 
classifications were then used in the qualitative analysis reported in 
Part. IV of this report*. Our sample of 4 J local units were categorized as 
follows: 'r ^ ' ^ . . ^ 

10 high performers (in top 25 percent of range of 188 scores) ' 
18 average performers 

15 low performers (in bottom 25 percent of range of 188 scores) 

Models of Socio-economic Influences on VT.N Performance , , ^ ^ 

This section synthesizes our findings on socio-economic environ- 
mental factors that have an influence on individual performance measures 
Into^a gene'ral explanatory model* Using path analysis,- we developed plau- 
sible causal explanations of the direct influence of socio-economic factors 
on intermediary performance measures and » in turn» their direct effect on 
welfare sayings* Environmental and performance data for the local WII 
units in*oiir study states were used in this analysis* The findings per^ 
mitted us to structure the relationships among environmental and per- 
formance variables* 




already mentioned » two sets of composite scores were used at 
the 4ocal levels one excluding the questionable retention rate measure^ 
The rankings of the programs > however, were similar on the two lists* 
The interview analysis presented in Part IV of this report suggests that 
high performing local offices have a balanced approach toward their pro- 
gram "mission" and probably perform equally well on all indicators* 
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Path, Analysis ' ' ' , • 

P '* ' 

Path analysis has been Increasingly used In the social sciences to 
construct an<^ assess causal models.* Our system of relationships among 
environmental and WIN performance variables was susceptible to such causal 
model Interpretations. Various models' "we re "develoi^^ 

which was the most plausible and powerful explainer of relationships. We 
present the most effective of these models In this section. 

Path analysis Is a i^owerful tool, but Its limitations should be 
understood. One path analysis does not permit definitive statements on 
^causality. Our data on- socio-economic and performance variables is cross- 
sectional, capturing circumstances In 214 local WIN units at only one 
point in time. However, a better test would exaiaine cause and effect over 
time. In addition, path analysis is not meant to* demonstrate causality. 
Rather, Its purpose is to identify the Implications of a set of causal 
assumptions that we Impose upon a system of obse.rved relationships.** 

Hypothesized Model *' 

We began our ^ath analysis by first constructing a general mod^l 
that showed hypothesized causal relationships among environmental and per- 
formance variables. This model is presented in Figure 19. 
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Figure 19 

Hypothesized Model of Causal Relationships 
Among Environmental and Performance Variables 



*A definitive presentation on the use of path analysis In social 
science research Is found In Blalock (1971). Additional contributions 
In the literature include Blalock (1964, l'968a, 1968b andn969), Boudon 
(1968), Duncan (1966 and 1975), and Helse (1969, 1970 and 1975). 

**Aa Sewall Wright, In his original work on path analysis, stated , 
"the method of path coefficients is not Intended to accomplish the Impos- 
sible task of deducing causal relations from the values of the correlation 
coefficients [(1934), p. 193]. . . . (However) in cases In which the causal 
relations are uncertain, the method can be used to find the logical conse- 
quences of any paikticular hypothesis In regard to them [(1921), p. 557]." 
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In developing this model, we made a number of assumptlone.' First, 
we assumed that eiivlroomental variables alight have ah effect on the Inter- 
medUfy performance measures Uetentloti rate, JqW entry wage rate and Job 
entries per staff), but that these Intermediary measures could not have an 
effect on environment. Likewise, the Intermediary variables might have an 
effect on welfare savings, but welfare savings could not Influence these 
performance measures** These assumptions are logical* and consistent with 
our ljuiowlege of the WIN program* « 

Second, we assumed that the observed variation In the intermediary 
performance variables were for the most part due to variations In Certain 
socio-economic variables. Also, it was assumed that variations in welfare 
savings were attributable to variations in the intermediary variables.** 

Having constructed this model » we then assessed the degree of In* 
tardcpcndence found among variables in the model* We also developed a set 
of regression equations to obtain information on the significance ^hd mag- 
nitude of Qausal relationships suggested by the model* 

Path Analytic Findings - « 

Statistical tests^were conducted on the data at different phases 
of our analysis to guarantee that assumptions underlying this analysis 
were not being violated • In addition, a number of competing causal models 
were considered and evaluated. The path analytic model preySented in Fig- 
ure 20 was Judged the "best" of these alternative models* That is, it 
provided a better explanation of the system of relationships existing, 
among environmental and performance variables than did other. models* 

The retention rate data problem identified earlier iij this section 
led us to drop retention rate from this model*, It proved not to be a 
significant e'xplainet of variat loner in welfare savings**** Improvements 
in the definition and reporting of this performance measure would likely 
increase its association with welfare savings* If such improvements were 
made, the path analytic model could be expanded to include the effect of 
retention rate* 

■ •- ■ . , , 

*this type of assumption is. required for path aualysis and is re- 
ferred to in the literature as "weak causal -ordering*" 
**Thl8 is called a "causal closure" assumption* 
***Retention rate, number of Job entries and Job entry wage to-, 
gether explained 49 percent of the variation in welfare savings* Exclud- 
ing retention jrate, 46 percent of the variation is explained* 
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Figure 20 

I'Jth Analytic Model of Socio-economic Impacts on WIN Performance 



The numbers on the vectbra or arrows in Figure 20 are path co- 
efficients** They Indicate, the relative* effect Independetit variables 
.have on dependent variables* • For exampld, a j&hange of one unit (tBei^sured . 
by one standard deviation) in the '^proportion lowwag^ industries" variable 
<»vould cause a •493 unit change in Job 6htry wfge ratje* Similarly a one 
junit change In '*job entries per staff** voul4 increase welfare grant reduc- 
tions by .SSI units* All path coefficients ifi the model are significant 
at the #01 level or greate^r. ? 



The values E.t and E^jare the variations in performance left 
unexplained by their respective tegression^equations* That iSt socio- 
ecx)nomic variables explain 30*4 percent (R ) of the variation in job en- 
tries per staff* Thus» 69*6 percent of the vd|^iation on < that measure ' 
^mong loc^l units is left unexplained* The comparable unexplained vari- 
ation for Job' entry wage rate was 47*9 percent* Analysis of Job entries 
per staff and job entry wage, rate on welfare 9aving« left 54«4 percent 
of the variation in monthly welfare reduction^ unexplained* The values 
assigned to the curved bi-directional lines ihdicate that the' residua^l 
values for the three measures used in the mod^l are uncorrelated * ^ 

The negative path coefficient fbr the relationship 1>etween jQb 
entry wage rate and welfare savings requires clarification* The job entry 
wage rate measure was a standardized .one » using Job entry wage rates rela- 
tive to local prevailing wage rates* Thust in communities where prevailing 
wages were Tel^tively lowt the average WIN ^age might approach or surpass 
the prevailing wage«^ ' fiut that entry wage was. still low» although it ap- 
proximated the area prevailing wage* Jobs with low er.try wages would not 
geneftate enough additional income to cause significant reductions in wel«- 
fare gilants,* Conversely, in communities with relatively high prevailing" 
wage rates, it would be m,ore unlikely for WIN average wage rates to ap- 
proximate prevailing rates* However, WIN entry wages probably would still 
be absolutely higher than in low wage are&s, 'even th<^^gh the standardized 
measure' might be lower* These higher job entry wageli (measured in absolute 
valued) wou).d generate larger Incomes and larger commensurate welfare grant 
reductions* As a consequence, the analysis shows an inverse relationship 
between standardized Job entry wage rate and welfare savings* 



*We chose in our analysis to define path coefficients as stand*- 
ardlzed regressioh coefficients or beta* weights. 
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^\ Potentia l Applications and Improvements 

previous sections have addressed how we conducted our analysis of 
state and local data on WIN performance Indicators and their association 
with socio-economic environmental variables. They showed how this analysis 
linked up ^th our content analysis of mostly qualitative information on . 

. organizational and process variables. This section focuseff on what could 
now be done, based on this study^ to provide more definitive statements 
About causa^ ordering among environmental and organizational variables 
and about expected Influettcea of induced changes in these variables on 

• program performance. 

' , '•.»''■•» 

The specific approach we used was necessitated by the exploratory 

, nature of our study. Little was known about WIN organizational character- 
istics or their likely influence, and that of environmental factors, on 

-program effectiveness. Therefore, we had to start by providing information 
oil phenomena associated with and directly descriptive .of state and local 
WIN operations. This information was used to define variables, to Identify 
the extent to, which they varied in operatibns g^tiMled, and to develop hy- 
potheses for testing. Analysis .was aimed at ^.dentifying systematic associ- 
ations among these variable^. Our findings suggested what organizational 

.characteristics differentiated relatively effective state and local WIN 
operations from relatively ineffective ones. To meet these objectives, 
we chose to combine statistical analysis of quantitative data on socid- 

' economic factors and performance indicators with content analysis of mostly 
qualitative information on the organizat^.onal characteristics of selected 
state and local WIN programs. - - - ^ - 

This section presents a statistical design that would simultane- 
ously analyze longitudinal data "on environmental, organizational and per- 
formance variables. This design would permtt inferences about causation 
among these -variables and could be used -in the. analysis recommended in 
Chapter 14. That chapter proposed a strategy for im^)3.ementing-^ifecommenda- 
tions .based on our research findings. Part of this strategy.for improving 
WIN program performance involved the development of a longitudinal data ' 
base for a stratified random sample of local WIN programs and rigorous, 
comprehensive analyses of these data. Both the data base development 
and the analytic design are premised on knowledge acquired through this 
exploratory study.. 

The proposed sample of local WIN units would be stratified by 
variables that are not likely to change significantly during a one-year 
period or during the shprt-run (a five-year period) and that are statis- 
tically significant correlates of program performance. Such stratifying 
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variables would be selected £rom those Identified as significantly related 
to UIM peVfbrmance, as presented' in Section 4 of this appendix* Data on \ 
organizational characteristics (including state central office Influences • 
on. local, operati-ons) voul(^ bfe obtained through standardised instruments.' 
This study has provided us with Icnowledge on what variables and what scalar 
measurements -to use in* these inb^ruments • , • 

^ Findings' £rbm analysis of these longitudinal data could satisfy 
a nuiober of Vjl^ program needs* First, they pould provide more objective 
daita on what could be expected of local<>;iriN operations In particular kinds 
^ of environments* This could asslsr state program coordinators and local 
^unlt srtaff In their Joint determination of activity and performance goalsV 
Regression analyse^ w6u\d' provide them with* a "prediction** equation* The 
geiSeral form of this regression equation would be similar to that presented 
in Sectlob* IV By assigning local unit values to the predictor variables^ 
program officials could obtain a range of v,aU|r8Tf«4: activity and perform- 
ance Indicators* that could be jased during gef^--settlng negotiations*^* 

' \. ^ • 

Such analysis could also have evaluative and allocatlve* utility* 
Local units whose* overall performance ^or performance on particular .indi- 
cators) fell within one standard deviation plus or minus their expected 
values could be viewed as approximating effectiveness levels x consistent 
with .what one would expect given their particular soclo<^ebonomic environs 
mepts***^ Those With actual values in excess of one standard error ^ of es- 
tlmate^would be considered relatively high performing operations* Those ; 
bel6w one standard error of the estimate would likely have organizational 
or process problems contributing to their relatively low performance show- 
ing* This performance categorization of local operations could be con- 
sidered during the within-state allocation and planning process* Those 
local units with performance problems might be singled out for in-deptl? 
review and dlagtiosis by regional and state WIN officials and for Joint 

^Regression. coe^XiiSlents and standard errors should be obtained 
through the "Jackknife" technique which involves construction of equally 
sized random samples of observations, sequential omission of one of the 
sample sg*ts and comp^j^tation of statistics^ and "averaging** of statistics 
derived from these computations* See Tukejih (1977) * * 

**Dependlng upon national policy^ data on performance or activity 
Indicators could be individually analyzed with environmental data^ or 
^overall effectiveness" scaled scores could be obtained through canonical 
* correlations or . factor analysis and these regressed on similarly aggre-^ 
gated measures of eflnrvironmental conditions* 
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stAte/local de^lopfcent of plans for corrective afction. Thus, state-level 
staff resources could be targeted on t'hose un^ts raqutrlng attention, and 
local staft and graining Iresources could be al'l%cajcd on a. more objective 
basis; . , ' 

*■ * „ • ' ' * .. ^ 

Since longitudinal data collection wpvld occur for both sponsor^ 
An<f SAU units, the above suggeatl:one for' planning > .evaluation and resource 
allocation are., not restricted just to WIN sponsor units, * They oould also 
apply independently 'to SAU uplts, or to some form of joint assessment' bf • 
local SAU/sponsor units. ** • ' 

' The second use of this longitudinal data base on a representative 

sample of local WIN units would be for "control" or, epmparison purposes 
during WIN experimentation or demonstration projects. Local WIN units' ' 
Involved In such projects could be matched to local units In the sample. 
The basis for .'such matches would' be environmental and organizational' data 
cfillected on demonstration sites aiid thBlr. historical performance levels. 
Thebe woul* be matched with those of units in the sample on a one-to-one ' 
basis. Th^ numbfer of saflipl^ units used for comparison sites .would be d6-^ 
pendent on the inferential powec desired and design/cost considerations- 
associated with a particular study. Examples of experimentation where 
such controls would be -desirable are the WIN labs. Job Search Training 
experimental sites; and performance improvement demonstrations proposed 
by. this study. ' .., . . 

• - . ■. ; •• . . . \ 

Thirdly, this longitudinal data base would provide federal and i 
state WIN administrators With (1) Informatlort on "natural"' chknges occur- 
ring over time in local WIN units, (2) data on the, effects on^loc.al pro- 
grams of changes in federal WIN policy and procedures,- add (3) a more 
definitive statement on th6 cauae and effect relatl/jnshlps' that exist' 
among environmental factors," organizational characteristics, and per- 
formance levels.- State and federal administrators could use the first 
two types of information to respond to changing realifies in the field 
or to fine tune policy directives to -more precisely bring about' desired 
changes in their program. ^""The remaining portions of this appendix ad- 
dress the thlrd\ype of knowlfedge and its utility to program managers. 

As stated- in Section 1, the exploratory nature of this studypre- 
cluded "definitive statements abopt cause and effect irelationships within 

dtate and loc,^l"WIN programs. HoweVtr,- such statements' could be made 

causation could be Inferr.,^ at relatively high level.s of conf idence^-wlth 
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analysis of longitudinal data on variables for which definitions and 
parameters, can be created as a result o£ our exploratory research. 
Such analysis would permit one to identify the determinants of perfdrmance 
in the WIN program and to predict the direction and magnitude of changes 
in performance levels that would result from measurable and induced changes 
In organizational variables that are within the control of WIN managers and 
staff* In effect, a program manager could institute change in an operation 
and be able to realize predictable levels of performance improvement. 
However, experimentation would be required to develop a set of feasible, 
appropriate and efficient ways of initiating and sustaining such structural, 
managerial and procedural changes. 

The statistical design presented here presupposes the development 
of a stratified ra'om. sample of local WIN units, the periodic acquisition 
of socio-economic data on service areas covered by these offices, the use 
of staaddtdlzed data collection Instruments to measure political environ- 
mental phenomena and organizational factors for the same time periods, and 
the collection of program activity and performance data for both local sponsor 
and SAU operations* The analytic design addresses the **spur iousness'* problem 
discussed in Section 1 of this appendix and permits the differentiation of 
direct and indirect effects of environmental and organizational factors on 
WIN performance. 

The statistical design* Involves a two stage regression analysis . 
of the following form: 

1st stage Y » a ^ 5^b L +lb S + ^b P -h R 
regression U>= 1 11 la Ij ja Ik ka wa 

2nd stage Y,^, - + b^^ + i X + R^^ 

regression 

where for the t^th local WIN program: 

Y =• Y^^^ « a composite, standardized performance measure or 
indicator for overall WIN effectiveness 

=» the ith variable describing the local labor market 



*We are indebted to Dr. Timothy Ling, formerly of The Urban Institute 
.ind currently with JWK International Inc., for his consultations and^ sugges- 
tlonj^ on this design. 
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^Jtt ' variable identifying aocio-demographic 

characteristics of the population In the program's 
catchment area and of the program's registrants 

^ka " ^^^^ variable describing local and state political' 
conditions 

^wa " residual variation for the first stage regression 

A . 1 , 

^la ' estimated effectiveness level as predicted by environ- 
mental independent variables In first stage regression. 

\a " variable describing organizational character- 

istics of program 

\a " resid^^l variation for the second stage regression 

The first stage regression is similar to the one presented in Sec- 
tion 1 and used In our analysis of state and local environmental influences 
on program performance (Sections 3 and 4. respectively). It differs in 
its inclusion of political factors (P) , data upon which would be obtaine4 
through standardized data ^collection instruments. The second stage regres- 
sion would use estimates from the first stage anc organizational descriptors 
to identify the combined influence of environmental and organizational fac- 
tors on WIN performance. Quantified organizational variables describing 
a random sample of local units would permit regression of these variables 
upon environmental variables as had been previously done with performance 
measures. In effect, it would permit the regression of the residual of 
organizational determinants (R — the residual of the regression of or- 
ganizational factors on environmental variables) on the residual of per- 
formance (R^— the residual of the regression of a composite performance 
measure on environmental variables) . Such a regression would provide 
unbiased regression coefficients. That is, possible spurious correlations 
existing between performance and organizational variables due to their 
common environmental determinants would no longer be at issue. Figure 21 
gives a graphical presentation of this general approach. 
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General Analytic Design for Unbiased Estimation of Environmental 
and Organizational Influences on Local WIN Performance 



While the above is a general analytic schema for addressing the in- 
fluences of environment and organizational characteristics on WIN perform- 
ance, specific proceduires are required to (1) identify primary variables 
for analysis and for use in (2) the development of composite measures for 
environment, organization and performance so that (3) the direct effect and' 
Indirect effect of environment on performance and the direct effect of 
organizational characteristics on performance can bd identified. Composite 
measures (the upper case P, S, L, Z and X in Figure 22 ) would be derived 
Using regression coefficients (the b's in Figure 22)*and a composite per- 
formance Indicator would be f,onnulated talcing an average of standardized 
variates.* The patH coefficients (P's in Figure 22 ) indicate the relative 
importance *of a composite .measure—the strength and direction of association 
between composite measures and between composite measures and residuals^** 



*Figure 22 regression coefficients with '*d'* subscripts would have 
d y when the performance composite measure was regressed on environmental 
factors and d - x when organizational factors werq regressed on these en- 
vironmental variables* 

composite path" coefficient is the ratio of the standard devi- 
ation of the composite dependent variable attributable to primary independ- 
ent variables within a composite, such as, X, with other composites, such 
as L, S and P (and thus Z) , in the regression held constant to th^ standard- 
ized deviation of that dependent variable (for example, P =» SD(Y )/SD(Y)« 

■ . ^ yx X 
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Sequentially^ this analysis would involve; 

*■ • 

(1) a first stage regression of the performance measure on all 
primary variables (lower case s^ p and x) selected for 
analysis; 

(2) estimation of expected performance based on environmental ^ 
Influences (Y ) and that are attributable to organizational fac-^ 
tors ^ 

(3) calculation of path coef f icients, P and P » and residual 

path coefficient P ;** 

yv 

(4) a second stag^ regression of ^ on the primary environmental 
variables; * ^ 



(5) estimation of expected performance ) due to direct effect 
of environment on organizations implediinting program;*** 

(6) calculation of composite path coefficient P and residual 

path coefficient P ;**** and 
^ xu' 

(7) derivation of a path analytic model for inferring causal 
ordering among variables and their relative importance as 
dot '.rminants of WIN performance* 



'* Vb z - Y and^b x » ? 
yz z ^ , yx X 

**P » SD(^ )/SD(Y); P « SD(^ )/SD(Y); and 
yz z yx X 



*** lb z - Y 

XZ X,Z 



2 

« y (1-R of first regression) 



****p - SD(^ )/SD($ ); P - V of second regression) 

XZ X,Z . X ' xu " . . ® 
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Aa shown In Figure 23 , all direct and' indirect effects of environmental/ 
organisational variables on WIN, performance are assessed In units of ex- 
pe<;ted perfonnance (as predicted by relevant primary variables). The 
square of a composite path coefficient provides a measure of the direct 
determination of that path (proportion of variation attributable to the 
direct effect of Independent variables). The sum of these path coeffi- 
cients squared Is the variation In performance among local units attri- 
butable t& all the composite measures Included in the model (and thus ' 
their primary variables). The square of the residual path coefficient 

yv^ * measure of nondetenninatlon (proportion of variation not 
accounted for by variables Included in the model). 




Figure 23 

Path Analytic Composite Regression Model of 
WIN Performance Determinants 
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APPENDIX C 

FfELD INTERVIEW GUIDE AND RESPONDENT LIST 



This appendix contains an outline of the guide used to conduct Interviews 
at the regional office, state and local levels^ as well as a list of types 
of respondents Interviewed at each level • Material Included for cueing and 
coding purposes in the guides used in the field have been deleted. Subject 
Items under each heading were coded to be asked of specified types of respond-* 
ents* The field researchers were Instructed to modify some items as necessary 
to fit different respondent types and to probe vague or unclear responses. 
Respondents were promised confidentiality as to their Identity , organlaatlon 
and location. 

Outline of Interview, Guide 

A. Personal Characteristics 

1. Education J * ' 

2. Work experience 

3. Job tenure 

4. Training 

» 

B. Formal Organization ^ . * 

1. Organisation chartb 

2. Staff rosters 

3. Reporting patterns ^ ^ 

C. Goal Struct ure 

1. Unit goals 

2. Superiors' goals 

3. Perceived Impact of goals 

D. Allqc ation Formula 

1. Distribution of information on the formula 

2. Perceived priorities 

3. Changes In priorities 

4. Influence of formula 

5. Regional distribution of discretionary funds 
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Unit Taska and Functlon^n f^ 

1. Unit tasks . .. 
2* Individual tasks. 

3. Intra-unit work flow patterns 

4. Task time allocations 

5. Suggested changes In task time allocations 

• 

F« Intra-Unlt Interaction 

'1. Co-worker Interaction patterns 

2. Supervisor Interaction patterns 
3.. . Intra-unlt meetings 

4. Non-work interactions 

G. Managerial Behavior 
' 1. Delegation of authority 

2. Response to staff suggest lon^ ^and change 

3. Approach to staff management 

4. Sources and frequency of conflict 
« 5. Modes of conflict resolution 

^* Service Delivery Technlqu'ea and Procedures 

1. Client flow 

2. Staff-client activities 

3. Treatment of voluntary participants . ' _ . _ 

4. Changes in service dellvei^y procedures, client floVs and service mix 

. * • 

!• OJT and Private Sector Placement 

1. Use of OJT contriacts 

2. Employer response to OJT and tax credit 

3. Perceived WIN OJT-CETA OJT interaction 

4. Types of private sector openings av^ailable/ut llized "for clients 

5. Employer receptivity to hiring WIN registrants 

J« Inter-unlt Interaction 

I.. Substance, frequency and character of Interaction with other units 

2. Office-wide meetings 

3. Non-work, interactions 

K. ES-WIN Relations 

I. ES-WIN unit differentiation 
^2. ES-WIN task Interchanges 

3. WIN access to ES job orders 

4. Perceived usefulness to WIN of Job Bank 

5. Cooperation and coordination with employer relations representatives 

and with Job Information System (JIS) 

6. Attitudes of ES staff to WIN (and visa versa) 
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7. Perceived impact of WIN presence on ES . 

8. Extent of ES-WIN. rivalry or tension 

9. « Mode of ES-WIM conflict resolution 

Sponsor^'SAU Linkages 

l.o .Character of coordinating mechanism or procedures 
2. Coordination problems and sdlutlons ' 
3e Sponsor-SAU task Interchanges - . ^ 

4e Formal and Informal contacts and Interactions 

5. Changes over time 

6. Collocation (and Integration) and Its perceived affect on operatlpns 

IMU-WIN Linkages ' ' ^ 

K Items similar to ••L'* above. 

* • * 

CETA Linkages 

!• Substance and frequency of contact 

2. CETA Intake and referral mechanism 

3e Proportion of WIN (AFDC) In CETA Training and PSE components 

4^ Prime sponsor* priority for welfare recipients 

5. Kinds of CETA training 

6. Sources of WIN-C£TA conflict and modes of resolution * 

7. WIN attitudes toward and opinion of CETA (and visa versa) 

8. Constraints on WIN participation in CETA PSE . 

9. ,CETA funding of WIN dtaf f positions ' ^ . 

10. Substance > .freq,uency and quality of information exchange 

9 

Vocational Education Linkages f 
le Frequency and subject of contacts 
2v Referral procedures 

3. Types of training 

A. ^.WIN staff involvement in Voc Ed curriculum development 

5. WIN attitude toward, and opinion of Voo Ed (and visa versa) 

Vocational Rehabilitation Linkages 

U Items similar to "0" above 

2e Specialized or^jolnt caseload management 

3* Staff cross-training 

4. R^hab attitudes toward welfare clients 

Other Agency Linkages 

1. Frequency, substance and recency of other service agency contacts. 

2. Referral procedures 

3. Perceived benefits . 

' . / 
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Personnel Svaf ms ' * . ^ 



I 
2 
3 
4 
5 
6 
7 
8 



Hiring and promotion prc^cedures 
Political influences 

Salary level competitiveness 
Affirmative action policies and mechanisms 
Veterans preferences . ' 

Degree and effects of ' unionization ' 
Perceived characteristics of WIN personnel 
Perqeived impacts of personnel system on program 



Facilities and Equipment 

1. Office location decision-making 

2. Perceived quality of«WIN unit office space and location 

3. Perceived effect of administrative support agencies on program 

. operations 

. *■ 
Regional Office 

1. Role and functioning of RCC 

2. Role and functioning of regional WIN unit 

3. Performance of specific tasks (resource allocation, monitoring, 
I site visiting, ^technical assistance, etc.) 

^4. Federal-state conflicts and mode of resolution 
5. Federal influences on state and local program operations ' 

Written and Oral Communication 

1. Nature, frequency and flow of communications 

2. Authority to modify or stop written communications 

3. Use of meetings, institutes, training sessions 

4. Compliance and disagreement' 

5. Feedl^ck mechanism and attitudes 

Political Influences 

1. Perceived influences of the political appointees in charge of the 

agency ' 

2. Rgrcelved influences of other state level political officials 

3. Perceived influences of local level political officials 
4: Politicians/ public positions on WIN and welfare 

5. Perceived influence of various lobbies and special Interest 
organizations 

T echnical Ass istance 
l» TA received 

2. TA usefulness, competence, limitations 

3. Unfilled needs, and suggested Improvements 
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X. Federal Funding * 
!• Changes in funding levels, delays, etc n 
2'. Perceived Impact on program operation ^ 

Y. State Funding 

1. Matching grants- ♦ 

2. Allocating Title XX funds 

3. Special initiatives . ' 

4. General austerity programs '. . 
5* Local contributions or in-kind subsidies 

Z. MIS 

I. Accuracy/ timeliness, credibility of ESARS, CAS, other MIS 
2* Managerial utilization ^ 
3* ^Staff EDP capacity 

4e • WIN-welfare reporting interface % 
5e Problems, innovations and suggestions, ^ 



AAe Planning 

I. Planning and activity t'arget setting prdcesses^ 

2« Realism and usefulness of plans 

3e . Sponsor-SAU unified budgeting and planning 

BBe Budget Review 

le State budget review 

2« State program analysis or oversight 

CCn Community Attitudes and Perceptions 
le General awareness of WIN 
2« Attitudes toward WIN, welfare and wor.k. 

DD» Asaessmeht and Welfare Reform 

le Perceived strengths and weakness of their WIN program 

2« Suggested Improvements 

3e Expectations about welfare reform 



Respondent Categories 
Regional Level 

Assistant Regional Director for Employment and Training (DOL-ETA) 
Regional Commissioner of Human Development ' Services (HEW-OHDS) 
Regional WIN Director 
WIN 'unit staff 
OPTS staff 
, ETI staff 
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* State Level 

State WIN Sponsor Coord Tna tor 
Other WIN Sponsor Central Office staff 
WIN Spon'sor Coordinator's supervisor 

State SAU Coordinator ' ' ^. 

Other SAU Ceritral Office ^taff . ^ ^ * 

SAU Coordinator's supervisor . • 

SESA Re.search and Statistics staff 
SESA Evaluation and Monitoring staff 
SESA Chief of Field Operations 
'Key manpower ^aide in governor'-s office 
CETA balance-of-state official ' . . - ' 

Bud(^*et examiner for WIN program 
Member of legislature or stiff familiar with WIN 

Officials from departibent of . education, vocational education, or- vocational . 

rehabilitation ^ 
Public service employees' union rcfpresenbative^ , ^ ^ 



. DlsMlct/Area Level 



WIN Sponsor supervisor 
ES supervisor t 
SAU Supervisor 



Local Level 



WIN sponsor unit supervisor ^. ' 

Intermediate supervisor in local WIN sponsor office 
ES office ihanager; 
Welfare administrator 
SAU supervisor ^ 

IMU supervisor ^ ' . 

SAU staff ^ 
IMU staff 

Job Bank supervisor 

CETA prime sponsor administrator or staff 
Vocational education administrator or staff 
Vocational rehabilitation administrator or staff 
Representatives of community-based organizations 
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